Skip to content
Submit incident
AII-1001-24149
AllegedThe record is a lawsuit, complaint or accusation that has not been decided.

Minors sue xAI alleging Grok generated sexualized deepfakes

Three Tennessee minors filed a class-action lawsuit against xAI alleging that its Grok image generator was used to create sexualized deepfakes of them from real photographs. The generated images were shared on social media and dark web platforms, allegedly causing severe psychological distress to the plaintiffs.

17 March 2026 · xAI · Harmful and abusive content
17 March 2026
AII-1001-241496 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
BBC
Date
17 March 2026
Drafted by
Raidu Incident Detection

What happened

Three minors from Tennessee filed a class-action lawsuit against xAI in federal court in San Jose on March 17, 2026, alleging that the company's Grok image generator was used to convert real photographs of the plaintiffs into sexualized deepfakes.

The lawsuit states that images created by a detained individual using Grok were shared across social media platforms including X, Discord, and Telegram, and subsequently migrated to the dark web where they were used as currency for other child sexual abuse material.

Reported impact

The three minors reported significant psychological and emotional distress, including panic attacks, sleep disturbances, and anxiety about public events. One plaintiff has recurring nightmares and another requires medication for sleep and fears attending her graduation ceremony.

The lawsuit alleges that xAI generated approximately 3 million sexualized images over 11 days in late 2025, of which about 23,000 depicted minors, according to a Center for Countering Digital Hate study.

Index analysis

The plaintiffs' counsel alleged that xAI deliberately designed Grok to produce sexually explicit content for financial gain without implementing safeguards used by other major AI companies to prevent generation of child sexual abuse material.

Following public outcry, xAI restricted image generation to paying subscribers in January 2026 and blocked users from editing images of people in revealing clothing and from generating such images in jurisdictions where it is illegal.

Governance controls

The lawsuit claims xAI failed to install adequate safeguards to prevent its systems from generating sexual content involving minors, in contrast to protections deployed by competing AI companies.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Psychological, Human or fundamental rights
Harmed
Children
Failure modes
Deepfake image, Content moderation failure
Consequences
Litigation
AI systems
Grok

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

BBC
Teens sue Elon Musk's xAI over Grok's pornographic images of them
16 March 2026
The Guardian
Teenage girls sue Musk's xAI, accusing Grok tool of creating child sexual abuse material
16 March 2026
Business Insider
Lawsuit against Elon Musk's xAI alleges Grok created sexualized deepfakes of 3 minors
16 March 2026
Morningstar
Elon Musk's xAI is facing a growing number of lawsuits over AI-generated deepfakes
16 March 2026
jpost.com
Minors sue xAI alleging Grok generated sexualized deepfakes
uol.com.br
Minors sue xAI alleging Grok generated sexualized deepfakes
Aug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.comAug 2026Survivor sues xAI alleging Grok generated CSAM from existing abuse imagesAllegedHarmful and abusive contentNEWS 24/7news247.gr