Details
Civitai's content moderation pipeline has evolved significantly through 2025. Images uploaded to the platform are scanned using Amazon Rekognition and an open-source tagging system to assign content labels and screen for prohibited material. In April 2025, Civitai announced a partnership with Clavata, a policy-driven content classification service, to replace earlier inconsistent systems. In March 2025, Civitai added VLM-based (vision-language model) scanning for images generated on-site. For text prompt moderation, OpenAI's prompt moderation API had been used to scan inputs. Certain tag combinations or resource types trigger a mandatory human moderator review before content becomes publicly visible. The system is combined with community-driven 'Knights of New Order' rating, in which users help classify borderline content. In 2024, the platform processed over 586,800 reports and removed over 730,000 images according to the company's own transparency report.
Have evidence about Civitai's AI practices? Submit a report.
Report a Sighting →