Content ModerationConsumer FacingVerified
Reviewed and published by trentmaziarz, March 22, 2026. Discovered and drafted by our automated research pipeline.
Xbox uses AI tools to automatically detect and block harmful messages, images, and voice chat on the Xbox gaming network — without waiting for players to report them. By November 2024, the system had blocked over 45 million harmful text messages and helped reduce voice-based harassment by 43%.
Details
Microsoft has deployed a layered AI moderation system on Xbox since 2023. Xbox AutoMod, launched in February 2024, uses machine learning to review reported text content and speed up human moderator decisions — handling 1.2 million cases and enabling 88% faster content removal within its first months. A voice moderation system introduced in July 2023 lets players capture audio clips of harassment and submit them for review using a "capture now, report later" model. As of the November 2024 Xbox transparency report, over 19 million pieces of violating content had been blocked in the first half of 2024 alone, and the system operates across 20 languages. Some players raised concerns about whether voice recordings could be misused, though Microsoft states clips are only captured at the player's explicit choice.
Products affected
Xbox Network (Xbox Series X|SXbox One)Xbox mobile appsCall of Duty (voice moderation)Minecraft Bedrock Edition
Sources & Evidence
Company Disclosure
Other practices by Microsoft
OtherProject InnerEye is a Microsoft Research initiative that uses AI to analyze 3D medical scans — primarily CT scans used for cancer radiotherapy planning — and automatically highlight the areas that need treatment. Peer-reviewed research found it can complete this task up to 13 times faster than a clinician doing it manually, while staying within the range of human expert accuracy.OtherSeeing AI is a free Microsoft app for people who are blind or have low vision. It uses the phone's camera and AI to narrate the world around the user — reading text out loud, identifying products by barcode, describing scenes, and recognizing faces. It launched on iOS in 2017 and became available on Android in December 2023, supporting 18 languages.OtherWindows Recall is an AI feature for Windows 11 that continuously takes screenshots of everything on a user's screen and stores them locally, so the user can later search their own history by typing questions like "find that recipe I was looking at last week." Announced in May 2024, it faced immediate criticism from security and privacy experts and was delayed multiple times before a limited release.
Have evidence about Microsoft's AI practices? Submit a report.
Report a Sighting →