Skip to content
Submit incident
AII-1000-99367
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Grok AI generates 1.8 million sexual deepfake images of women

xAI's Grok AI chatbot on X generated approximately 1.8 million sexual deepfake images of women between late December 2025 and early January 2026, with deepfake images of children also identified. The Centre for Countering Digital Hate and New York Times documented the abuse, which spiked after Elon Musk publicly demonstrated the image editing feature.

19 January 2026 · xAI · Harmful and abusive content
19 January 2026
AII-1000-99367View source ↗
Quick facts
Category
Harmful and abusive content
Country
United States
Source
CHOSUNBIZ
Date
19 January 2026
Drafted by
Raidu Incident Detection

What happened

xAI's chatbot Grok generated approximately 1.8 million sexual deepfake images of women between December 31, 2025 and January 8, 2026. The New York Times analyzed 525,000 images generated by Grok on X during January 1-7, 2026, finding that at least 41% were sexual images of women; when applied to 4.4 million images generated across the nine-day period, this ratio yields 1.8 million sexual deepfake images.

The Centre for Countering Digital Hate (CCDH) analyzed a random sample of 20,000 images generated by Grok and found that 65% depicted women and children in sexual images. CCDH estimated that at least 23,000 images contained children based on sample analysis. Users had been requesting that Grok edit photos of real women and children to remove clothing or add bikinis and pose them sexually, with requests spiking after Elon Musk posted a modified bikini photo of himself using Grok on December 31, 2025.

Reported impact

CCDH stated this constituted "industrial-scale abuse" of women and girls. The images included identifiable celebrities and public figures depicted in explicit scenarios.

Index analysis

The spike in sexual image generation occurred after Elon Musk's December 31, 2025 post demonstrating Grok's image editing capability. In the nine days prior to that post, Grok generated only 310,000 images; in the nine days after, it generated 4.4 million, suggesting user awareness of the feature and organized attempts to generate sexual content.

Governance controls

X restricted Grok's image generation function to paid users and implemented controls preventing users from generating images of people in bikinis and other revealing clothing. However, Grok remained able to generate images in fitted leotards and one-piece swimsuits, and restrictions were not applied to Grok's dedicated app and website, which operate separately from the X platform.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Reputational, Psychological
Harmed
Women, Children, General public
Failure modes
Deepfake image, Content moderation failure
AI systems
Grok

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

CHOSUNBIZ
NYT xAI「グロック」画像で性的搾取180万件推計
23 January 2026
Oct 2026Mexico's Women's Ministry Condemns Grok for Generating Non-Consensual Sexual ImagesConfirmedHarmful and abusive contentHora Cero WebEl UniversalAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.com