Content ModerationInternal OnlyVerified
Reviewed and published by trentmaziarz, March 22, 2026. Discovered and drafted by our automated research pipeline.
Azure AI Content Safety is a Microsoft cloud service that other companies can plug into their own products to automatically screen text and images for harmful content — such as hate speech, sexual material, violence, and self-harm. It launched in May 2023 and also powers safety filters inside Microsoft's own AI products, including Bing and GitHub Copilot.
Details
Announced at Microsoft Build on May 23, 2023 and reached general availability later that year. The service uses machine learning models to evaluate content across four harm categories — hate, sexual, violence, and self-harm — and returns a severity score (0–6) per category. It supports eight or more languages and can be customized with company-specific blocked term lists. Azure AI Content Safety also includes Prompt Shields, which detect attempts to manipulate AI systems through crafted inputs (jailbreak attacks). It is a B2B (business-to-business) service, meaning businesses pay to use it via API rather than end users accessing it directly. TechCrunch noted that the launch came shortly after Microsoft dissolved its AI ethics team, raising questions about governance continuity.
Products affected
Azure OpenAI ServiceAzure AI FoundryGitHub CopilotMicrosoft CopilotBingthird-party applications using the API
Sources & Evidence
Company Disclosure
Other practices by Microsoft
OtherProject InnerEye is a Microsoft Research initiative that uses AI to analyze 3D medical scans — primarily CT scans used for cancer radiotherapy planning — and automatically highlight the areas that need treatment. Peer-reviewed research found it can complete this task up to 13 times faster than a clinician doing it manually, while staying within the range of human expert accuracy.OtherSeeing AI is a free Microsoft app for people who are blind or have low vision. It uses the phone's camera and AI to narrate the world around the user — reading text out loud, identifying products by barcode, describing scenes, and recognizing faces. It launched on iOS in 2017 and became available on Android in December 2023, supporting 18 languages.OtherWindows Recall is an AI feature for Windows 11 that continuously takes screenshots of everything on a user's screen and stores them locally, so the user can later search their own history by typing questions like "find that recipe I was looking at last week." Announced in May 2024, it faced immediate criticism from security and privacy experts and was delayed multiple times before a limited release.
Have evidence about Microsoft's AI practices? Submit a report.
Report a Sighting →