Content ModerationVerified
Reviewed and published by trentmaziarz, July 23, 2026. Discovered and drafted by our automated research pipeline.
Mistral AI offers a Moderation API that classifies text inputs — including user prompts and AI-generated outputs — into nine harmful content categories, powering the safety guardrails inside Le Chat and available to third-party developers for their own applications.
Details
The Moderation API is powered by a classifier model based on Ministral 8B and provides two endpoints: one for raw text and one for conversational content. It classifies text into categories including sexual content, hate and discrimination, violence and threats, self-harm, and PII (personally identifiable information). Developers can integrate the API into their own pipelines with customizable sensitivity thresholds. The API also powers the moderation system inside Le Chat itself.
Products affected
Mistral Moderation APILe ChatMistral AI Studio
Sources & Evidence
Company Disclosure
Cite this record
Trace Foundation. (2026). Mistral AI: Mistral AI offers a Moderation API that classifies text inputs — including user prompts and AI-generated outputs — into nine harmful content categories, powering the safety guardrails inside Le Chat and available to third-party developers for their own applications (data as of 2026-07-23) [Data set record]. AI Trace. https://www.aitrace.org/r/practice/aa01625b-6b51-4416-abff-f6ff6f6eeb0e. Accessed September 7, 2026.
- Stable link
- https://www.aitrace.org/r/practice/aa01625b-6b51-4416-abff-f6ff6f6eeb0e
- Data as of
- July 23, 2026
- Last verified
- Not recorded
Other practices by Mistral AI
OtherMistral AI deployed Voxtral, a family of open-weight speech recognition models released in July 2025 and updated in February 2026, which transcribe audio in 13 languages, identify different speakers, answer questions about audio content, and support real-time streaming transcription.Customer SvcMistral AI deployed Le Chat, a general-purpose AI assistant available to all users for free, which handles a wide range of conversational tasks including question answering, document analysis, web search, meeting summarization, and automated follow-ups for individuals and enterprise teams.RecommendationMistral AI offers a 'Memories' feature inside Le Chat, launched in September 2025, which is opt-in and stores user preferences and past conversation context to deliver more personalized recommendations and responses across future sessions.
Have evidence about Mistral AI's AI practices? Submit a report.
Report a Sighting →