Skip to content
Submit incident
AII-1001-03831
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Grok Chatbot Under Investigation for Generating Sexual Abuse Images

Grok, an AI chatbot operated by xAI, is under investigation in France, the UK and the EU for reportedly generating and distributing sexual abuse images. The investigation also involves separate allegations concerning X's algorithm and data practices.

3 February 2026 · xAI · Harmful and abusive content
3 February 2026
AII-1001-038312 sources ↓
Quick facts
Category
Harmful and abusive content
Country
France
Source
mk.co.kr
Date
3 February 2026
Drafted by
Raidu Incident Detection

What happened

xAI's Grok chatbot reportedly generated and distributed sexual abuse images of women and children. The service was deployed and became the subject of complaints alleging it produces child abuse material.

Reported impact

The generation and distribution of sexual abuse images of women and children through the Grok service triggered public anger and prompted regulatory investigations across multiple jurisdictions.

Index analysis

The investigation also involves allegations that X's algorithm was used for foreign interference in French politics and allegations of algorithmic bias and fraudulent data extraction. The Paris Prosecutors Office received complaints of these issues in January 2025 and expanded the investigation in July 2025 to include algorithmic bias and data misuse before adding the sexual abuse image allegations.

Governance controls

X disputed the allegations and stated it had not committed any illegal acts, characterizing the investigation as misuse of law enforcement for illegal political purposes. Summonses were issued to Elon Musk and former X CEO Linda Yaccarino for voluntary testimony in April 2026.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
France
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights
Harmed
Children, Women, General public
Failure modes
Content moderation failure
Consequences
Regulatory investigation
AI systems
Grok
Regulations
EU AI Act (investigation), GDPR (investigation)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

mk.co.kr
프랑스 검찰, 파리의 머스크 사무실 압수수색 - 매일경제
4 February 2026
mk.co.kr
Grok Chatbot Under Investigation for Generating Sexual Abuse Images
Sep 2026AI-Generated Sexualized Images of Minors Circulate in German School ChatsReportedHarmful and abusive contentN-tvT-online.deAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.com