Content ModerationConsumer FacingVerified
Reviewed and published by trentmaziarz, March 18, 2026. Discovered and drafted by our automated research pipeline.
Twitch deployed Harmful Chatter Detection, a machine learning feature rolled out in August 2024 that flags both potential ban evaders and potential harassers in a channel before they post. The feature extends the earlier Suspicious User Detection tool and surfaces flagged users to channel moderators for review.
Details
Twitch announced Harmful Chatter Detection on August 6, 2024 via @TwitchSupport on X (formerly Twitter). Twitch stated: "Using machine learning, the new Harmful Chatter Detection setting will help flag both potential ban evaders and potential harassers in your channel so you can keep an eye on them and protect your community." The feature builds on the earlier Suspicious User Detection tool, which was limited to ban evasion, by adding proactive harasser identification as a second detection category.
Products affected
Twitch ChatMod ViewSuspicious User Controls
Sources & Evidence
News Article
Cite this record
Trace Foundation. (2026). Twitch: Twitch deployed Harmful Chatter Detection, a machine learning feature rolled out in August 2024 that flags both potential ban evaders and potential harassers in a channel before they post. The feature extends the earlier Suspicious User Detection tool and surfaces flagged users to channel moderators for review (data as of 2026-06-06) [Data set record]. AI Trace. https://www.aitrace.org/r/practice/38daa539-8a6d-4021-a32c-6cf100a403ea. Accessed October 11, 2026.
- Stable link
- https://www.aitrace.org/r/practice/38daa539-8a6d-4021-a32c-6cf100a403ea
- Data as of
- June 6, 2026
- Last verified
- Not recorded
Other practices by Twitch
ModerationFollowing a high-profile deepfake scandal in January 2023, Twitch established explicit policies banning synthetic non-consensual exploitative images (NCEI) and updated its automated enforcement systems to detect and remove such content, with first-offense indefinite suspension.Data AnalysisTwitch uses machine learning models trained on billions of daily data events to detect fraud, personalize gift subscription recipients, and optimize Hype Train engagement settings for each channel.Data AnalysisTwitch uses algorithmic ad-serving systems — integrated with Amazon's advertising platform since 2020 — to evaluate ad opportunities, match ads to audiences based on interest and behavior signals, and implement brand safety and fraud prevention measures.
Have evidence about Twitch's AI practices? Submit a report.
Report a Sighting →