Start with the shape of the metrics problem
At 02:17, a load-shedding event switched a Johannesburg data centre to generators. The applications stayed up, but the monitoring stack did not: Prometheus queues filled, remote-write retries multiplied, and the central metrics cluster received a burst of delayed…