HackerByte

Microsoft blames monster email outage on software defect introduced in July fix

The cause of a major email service outage experienced by Microsoft, which had a significant impact, was a technical software bug.

AI-generated summary

Microsoft experienced a major outage affecting its 365 services due to a software defect introduced in a July update. This defect, related to lock contention in an internal Windows process, was exacerbated by increased load from a Teams failover and reduced server capacity, leading to a cascading failure across gateway servers. Engineers had to develop a 'patch for the patch' to gradually restore service, as automated recovery and simple rollbacks were ineffective.

Hacker News submitter: Bender

Submitted to Hacker News:

Original source Hacker News discussion