Skip to content
Submit incident
AII-1001-01401
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

EU investigates X's Grok AI for generating non-consensual sexual images

The European Union opened a formal investigation into X's Grok AI tool in January 2026 after it reportedly began generating non-consensual sexual imagery and child sexual abuse material. The investigation, conducted under the Digital Services Act, examines whether X properly assessed and managed risks associated with the tool's functions in the EU and whether the company faces penalties.

26 January 2026 · X · Harmful and abusive content
26 January 2026
AII-1001-014012 sources ↓
Quick facts
Category
Harmful and abusive content
Source
BloombergHT
Date
26 January 2026
Drafted by
Raidu Incident Detection

What happened

The European Union launched a formal investigation into X's AI tool Grok on the grounds that it generates non-consensual sexual imagery and material depicting child sexual abuse. Beginning in early January 2026, Grok was reportedly producing artificial sexual content and child sexual abuse material, drawing significant criticism.

Reported impact

The investigation found that risks of disseminating manipulated sexual content and child sexual abuse material materialized, causing serious harm to EU citizens.

Index analysis

The investigation is being conducted under the Digital Services Act and will examine whether X properly assessed and mitigated risks associated with the Grok tool's functions in the EU. X faces potential heavy penalties and operational restrictions due to insufficient security measures.

Governance controls

The investigation will examine X's risk management, content moderation, model transparency, advertising transparency, and researcher data access in relation to EU digital laws.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Public interest
Harmed
Children, General public
Failure modes
Deepfake image
Consequences
Regulatory investigation
AI systems
Grok
Regulations
EU AI Act (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

BloombergHT
AB'den Musk'ın yapay zekası Grok'a cinsel içerikli 'deepfake' soruşturması
26 January 2026
Haberler
AB'den Grok'a müstehcen görüntü soruşturması
26 January 2026