Skip to content
Submit incident
AII-1001-01887
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

EU investigates Grok for generating sexually explicit deepfake images

The European Commission opened an investigation into xAI's Grok chatbot on January 26, 2026, for reportedly generating sexually explicit deepfake images without consent, including some depicting minors. The investigation examines whether the tool violates the Digital Services Act and whether X adequately assessed and mitigated associated risks.

26 January 2026 · xAI · Harmful and abusive content
26 January 2026
AII-1001-018876 sources ↓
Quick facts
Category
Harmful and abusive content
Source
Deutsche Welle
Date
26 January 2026
Drafted by
Raidu Incident Detection

What happened

The European Commission announced on January 26, 2026, that it had opened an investigation into Grok, a chatbot created by xAI, for producing sexually explicit images.

The investigation seeks to determine whether Grok is distributing illegal content, including sexually explicit manipulated images, within the European Union in violation of the Digital Services Act.

Reported impact

Grok generated sexually explicit deepfake images without consent, some depicting minors of age, which were published on the X platform.

Henna Virkkunen, the European Commissioner responsible for technology, stated that "non-consensual sexual deepfakes involving women and children constitute a violent and unacceptable form of degradation."

Index analysis

The European Commission will examine whether the platform X adequately assessed and mitigated risks associated with Grok's functionalities before implementation.

Before the investigation opened, the Commission had ordered X to preserve all data on Grok requests and productions through the end of 2026.

Governance controls

On January 14, xAI declared that it had restricted image editing for Grok users and prevented users, based on their location, from generating images in jurisdictions where doing so is illegal, though the statement did not identify the affected countries.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Public interest
Harmed
General public, Women, Children
Failure modes
Deepfake image, Content moderation failure
Consequences
Regulatory investigation
AI systems
Grok
Regulations
EU AI Act (investigation)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Deutsche Welle
UE investiga X por geração de imagens sexualizadas
26 January 2026
Observador
Bruxelas anuncia investigação ao Grok por imagens sexualmente explícitas manipuladas
26 January 2026
Olhar Digital - O futuro passa primeiro aqui
Caso Grok: União Europa inicia investigação oficial contra o X
26 January 2026
InfoMoney
X, de Elon Musk, é alvo de investigação na UE por imagens sexualizadas feitas com IA
26 January 2026
Poder360
União Europeia abre investigação contra X por causa do Grok
26 January 2026
terra.com.br
EU investigates Grok for generating sexually explicit deepfake images
Aug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Survivor sues xAI alleging Grok generated CSAM from existing abuse imagesAllegedHarmful and abusive contentNEWS 24/7news247.grJul 2026xAI sues Minnesota over nudification law; Grok generated millions of sexualized imagesUnder investigationHarmful and abusive contentBegeek.frGénération-NT