# Microsoft blames monster email outage on software defect introduced in July fix

- HackerByte page: <https://hackerbyte.net/en/stories/the-cause-of-a-major-email-service-outage-experienced-by-microsoft-which-had-a-s-50517321>
- Original source: <https://www.theregister.com/saas/2026/11/16/microsoft-blames-monster-email-outage-on-software-defect-introduced-in-july-fix/5310026>
- Hacker News discussion: <https://news.ycombinator.com/item?id=50517321>
- Submitted to Hacker News: 2026-11-16T13:18:22.000Z

The cause of a major email service outage experienced by Microsoft, which had a significant impact, was a technical software bug.

## AI-generated summary

Microsoft experienced a major outage affecting its 365 services due to a software defect introduced in a July update. This defect, related to lock contention in an internal Windows process, was exacerbated by increased load from a Teams failover and reduced server capacity, leading to a cascading failure across gateway servers. Engineers had to develop a 'patch for the patch' to gradually restore service, as automated recovery and simple rollbacks were ineffective.

## Key points

- A July 2026 software update introduced a defect causing lock contention and resource exhaustion on gateway servers.
- The outage was triggered by a Teams failover increasing load and a simultaneous reduction in server capacity.
- Load testing focused on weaker hardware, failing to identify the defect's impact on newer, multi\-core systems.
- Automated recovery and rollback processes were insufficient to address the widespread server unresponsiveness.
- Engineers deployed a 'patch for the patch' to revert the defective code and restore services gradually.
