Skip to content
Submit incident
AII-1001-03351
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Grok AI generated non-consensual sexual deepfakes of women and minors

Elon Musk directed xAI to loosen content moderation on Grok to generate sexually explicit material and increase user engagement, reportedly resulting in approximately 23,000 non-consensual sexualized images of women and images appearing to depict minors. Internal security teams warned the changes violated laws and could enable child sexual abuse material, but the modifications proceeded.

January 2026 · xAI · Harmful and abusive content
January 2026
AII-1001-033512 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
20 minutos
Date
January 2026
Drafted by
Raidu Incident Detection

What happened

Elon Musk directed xAI to relax content moderation guidelines on Grok, the AI chatbot integrated into X, to increase user engagement through generation of sexually explicit material. Employees were required to sign liability waivers and train the system using explicit sexual audio and interactions, including conversations from Tesla vehicles.

When Grok's image editing tools were integrated into X in December 2025, any user with an account could create AI images. This resulted in a wave of non-consensual sexualized images, with the Center for Countering Digital Hate estimating approximately 23,000 sexualized images appearing to depict minors.

Reported impact

Internal security teams at X repeatedly warned management in meetings and messages that the tools could allow users to create AI images of child sexual abuse material or non-consensual sexual deepfakes of celebrities, potentially violating laws. The company warned its own staff that exposure to the content could be traumatizing and cause psychological stress.

Index analysis

Downloads of Grok increased 72% in the first three weeks of January 2026, reaching the top 10 in Apple's app store. The platform also launched erotic 'AI companion' features, with one bot called 'Ani' programmed to be 'extremely jealous' and 'always a little excited'.

Governance controls

Musk stated he had 'no knowledge of any naked images of minors generated by Grok' and claimed Grok would refuse to produce illegal content as it follows the law of each country. However, documentation obtained by The Washington Post showed security teams' warnings about legal violations were overridden.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological, Public interest
Harmed
General public, Women, Children
Failure modes
Deepfake image, Content moderation failure
AI systems
Grok
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

20 minutos
Elon Musk permitió la generación de contenido sexual en su IA para ganar usuarios pese a los riesgos legales
2 February 2026
uol.com.br
Grok é sexualizado para ganhar usuários, diz jornal; Musk alega seguir lei
2 February 2026
Aug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.comAug 2026Survivor sues xAI alleging Grok generated CSAM from existing abuse imagesAllegedHarmful and abusive contentNEWS 24/7news247.gr