grafana
Why a dashboard did not explain the outage
At 18:07 on a Tuesday, a payment service started timing out in Johannesburg. The first alert blamed CPU. The second blamed Redis. Neither was useful: the real problem was elevated latency on the route to an upstream service…