Content ModerationConsumer FacingVerified
Reviewed and published by trentmaziarz, March 18, 2026. Discovered and drafted by our automated research pipeline.
Twitch tested an ML-powered prompt system that detects potentially harmful chat messages before they are sent and asks users "Are you sure you want to send this?" — nudging them to reconsider without blocking the message outright.
Details
Announced as an experiment rolled out in phases. According to Twitch's 2024 Annual Transparency Report for the New Zealand Code of Practice, the nudges resulted in a 9.26% reduction in toxic chat messages without significantly affecting user engagement, with 98.23% of nudged users returning to chat within 48 hours. As of the report date, the experiment was active for approximately 10% of users. Twitch's official statement: "We're rolling out an experimental prompt powered by machine learning that encourages users to pause before sending chat messages that are potentially harmful."
Products affected
Twitch Chat
Sources & Evidence
Cite this record
Trace Foundation. (2026). Twitch: Twitch tested an ML-powered prompt system that detects potentially harmful chat messages before they are sent and asks users "Are you sure you want to send this?" — nudging them to reconsider without blocking the message outright (data as of 2026-03-18) [Data set record]. AI Trace. https://www.aitrace.org/r/practice/b575c582-c329-4dd4-820e-e70d6cb5f6da. Accessed October 13, 2026.
- Stable link
- https://www.aitrace.org/r/practice/b575c582-c329-4dd4-820e-e70d6cb5f6da
- Data as of
- March 18, 2026
- Last verified
- Not recorded
Other practices by Twitch
ModerationFollowing a high-profile deepfake scandal in January 2023, Twitch established explicit policies banning synthetic non-consensual exploitative images (NCEI) and updated its automated enforcement systems to detect and remove such content, with first-offense indefinite suspension.Data AnalysisTwitch uses machine learning models trained on billions of daily data events to detect fraud, personalize gift subscription recipients, and optimize Hype Train engagement settings for each channel.Data AnalysisTwitch uses algorithmic ad-serving systems — integrated with Amazon's advertising platform since 2020 — to evaluate ad opportunities, match ads to audiences based on interest and behavior signals, and implement brand safety and fraud prevention measures.
Have evidence about Twitch's AI practices? Submit a report.
Report a Sighting →