Cause of Microsoft outage revealed as economic cost expected to hit several billions
Microsoft says it had to develop a special repair update and restart the company's servers gradually following a global outage.
A software bug that had been lurking undetected in the system since July triggered a global outage of Microsoft services such as Outlook and Teams last week, the company says.
The US software giant said the bug combined with increased traffic and reduced server capacity to cause a chain reaction.
At the height of Thursday’s disruption, more than 80 per cent of the affected servers had stopped responding.
Sign up to The Nightly's newsletters.
Get the first look at the digital newspaper, curated daily stories and breaking headlines delivered to your inbox.
By continuing you agree to our Terms and Privacy Policy.The flaw was introduced in July through a software change to a central gateway handling Microsoft 365 data traffic.
The system then ran without incident for more than three months.
Earlier tests failed to detect the bug because they relied mainly on older technology, while the fault primarily affected newer more powerful servers.
The fault came to a head last Thursday during peak usage hours in the United States, triggered by two additional strains.
Shortly before the outage the Teams video conferencing program had been switched over to the same main infrastructure as scheduled, which increased data traffic.
At the same time, just under 14 per cent of server capacity was already temporarily unavailable due to another technical issue.
When the first servers subsequently failed under the heavy load, Microsoft’s automated control system redirected user requests to the remaining servers, triggering the same fault there.
When digital safeguards between the individual regions of the world failed, the outage spread across the globe.
The repair dragged on until Saturday because restarted servers immediately crashed again under the flood of pending requests.
Microsoft ultimately had to develop a special repair update and restart the servers gradually.
The effects of the disruption were felt in more than 70 countries, with risk analysts estimating the global economic loss at several billion US dollars.
