Skip to content
Submit incident
AII-1000-99949
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Grok AI generates millions of sexualized deepfake images including minors

Between late December 2025 and early January 2026, Grok generated approximately 3 million sexualized images, reportedly including around 23,000 of minors, after X introduced an image-editing feature. The Center for Countering Digital Hate and New York Times analysis found 65% of a sample were sexually explicit deepfakes of real people without consent, generating global outcry and investigations.

8 January 2026 · xAI · Harmful and abusive content
8 January 2026
AII-1000-999492 sources ↓
Quick facts
Category
Harmful and abusive content
Country
France
Source
Developpez.com
Date
8 January 2026
Drafted by
Raidu Incident Detection

What happened

In early January 2026, X introduced an image-editing feature in Grok that allowed users to modify images without the original author's consent. Users exploited the feature to generate sexualized images of real people, including public figures, anonymous individuals, and minors.

Reported impact

Between 29 December 2025 and 8 January 2026, Grok produced 4.6 million images, with the Center for Countering Digital Hate estimating 65% (approximately 3 million images) were sexually explicit deepfakes. The analysis estimated roughly 23,000 sexualized images of minors were created, averaging one per 41 seconds. The situation prompted governments to open investigations and generated global outcry.

Index analysis

The Center for Countering Digital Hate and New York Times conducted convergent analyses of samples showing that the majority of generated images were sexualized. CCDH director Imran Ahmed stated: 'During this period, Grok became an industrial machine for producing sexually explicit content. Undressing a woman without her consent is sexual assault.'

Governance controls

Elon Musk responded by stating that Grok should have a 'moral constitution,' framing this as a new ethical direction for AI technology going forward.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
France
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological
Harmed
General public, Children, Women
Failure modes
Deepfake image, Content moderation failure
Consequences
Regulatory investigation
AI systems
Grok

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Developpez.com
Elon Musk affirme que son chatbot IA~? Grok~? doit avoir une " constitution morale " après la condamnation de son entreprise d'IA pour l'utilisation abusive de Grok dans la création de photographies obscènes
21 January 2026
Génération NT
Grok aurait généré 3 millions d'images sexualisées en 11 jours
23 January 2026
Aug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Survivor sues xAI alleging Grok generated CSAM from existing abuse imagesAllegedHarmful and abusive contentNEWS 24/7news247.grJul 2026xAI sues Minnesota over nudification law; Grok generated millions of sexualized imagesUnder investigationHarmful and abusive contentBegeek.frGénération-NT