20230829 – Widespread Network Outage at NEXTDC B2 - PUBLIC

NOTICE TIME ZONE	Brisbane UTC +10
STATUS (Open/Closed)	Closed
INCIDENT CAUSED BY A 3RD PARTY?	No
IF YES, NAME OF 3RD PARTY	N/A
INCIDENT START DATE	20230829
INCIDENT START TIME (HH:MM)	15:23
ESTIMATED TIME TO RESOLUTION
INCIDENT END DATE	20230829
INCIDENT END TIME (HH:MM)	16:12
INCIDENT TOTAL DURATION	49 minutes
XCRM TICKET NUMBER	Not Applicable
BRAND	XNET
PRIORITY	P1
CLIENTS AFFECTED	All Clients
DESCRIPTION OF INCIDENT	All Services
EVENT TIMELINE
	Tuesday 29th August 2023
15:23	XSTRA Monitoring indicates all communications at NEXDC B2 are down
15:35	Technician has been despatched to NEXTDC B2 site – ETA 25 minutes
15:55	Hardware determined at fault
16:10	Hardware replaced
RECOVERY & RESOLUTION	Hardware replaced
ROOT CAUSE	Mikrotik CRS 1036 in boot loop
CORRECTIVE & PREVENTATIVE MEASURES	N/A – hardware will fail at some point – replacement hardware was ready and pre-configured for efficient and timely swap out

Feedback