AI TraceTrace Foundation, Inc.
Content ModerationConsumer FacingVerified

Reviewed and published by trentmaziarz, March 22, 2026. Discovered and drafted by our automated research pipeline.

Xbox uses AI tools to automatically detect and block harmful messages, images, and voice chat on the Xbox gaming network — without waiting for players to report them. By November 2024, the system had blocked over 45 million harmful text messages and helped reduce voice-based harassment by 43%.

Details

Microsoft has deployed a layered AI moderation system on Xbox since 2023. Xbox AutoMod, launched in February 2024, uses machine learning to review reported text content and speed up human moderator decisions — handling 1.2 million cases and enabling 88% faster content removal within its first months. A voice moderation system introduced in July 2023 lets players capture audio clips of harassment and submit them for review using a "capture now, report later" model. As of the November 2024 Xbox transparency report, over 19 million pieces of violating content had been blocked in the first half of 2024 alone, and the system operates across 20 languages. Some players raised concerns about whether voice recordings could be misused, though Microsoft states clips are only captured at the player's explicit choice.

Products affected

Xbox Network (Xbox Series X|SXbox One)Xbox mobile appsCall of Duty (voice moderation)Minecraft Bedrock Edition

Sources & Evidence

Other practices by Microsoft

Have evidence about Microsoft's AI practices? Submit a report.

Report a Sighting →