Skip to content
Submit incident
AII-1000-94987
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

EU Investigates Grok AI for Generating Child Sexual Abuse Deepfakes

The European Commission and Paris Prosecutor's Office are investigating reports that Grok, an AI tool made by xAI for the X platform, was used to generate and distribute deepfake videos of child sexual abuse material. xAI acknowledged technical deficiencies in the system that allowed such content to be generated.

5 January 2026 · xAI · Harmful and abusive content
5 January 2026
AII-1000-949872 sources ↓
Quick facts
Category
Harmful and abusive content
Source
hotnews.ro
Date
5 January 2026
Drafted by
Raidu Incident Detection

What happened

The European Commission announced on 5 January 2026 that it was analyzing allegations that Grok, an AI tool from Elon Musk's xAI, was being used to generate and distribute sexual images of minors via its 'spicy mode' feature on the X platform.

The Paris Prosecutor's Office extended an existing investigation into X to examine accusations that Grok was being used to generate and distribute child sexual abuse material.

Reported impact

Deep fake videos with explicit sexual content involving minors were reportedly circulated on the X platform, prompting EU officials to describe such material as 'illegal,' 'disgusting,' and as having 'no place in Europe.'

Index analysis

xAI stated in the reported period that it was making efforts to address problems with the Grok AI tool.

The EU had previously fined X 120 million euros in December 2025 for violations of digital content regulations, and is continuing investigation under EU digital services law initiated in December 2023.

Governance controls

EU officials stated they were taking the matter very seriously and applying digital services regulations rigorously, noting that X had been warned through the previous fine imposed in December 2025.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights
Harmed
Children
Failure modes
Deepfake video, Content moderation failure, Deepfake image
Consequences
Regulatory investigation
AI systems
Grok
Regulations
EU AI Act (investigation)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

hotnews.ro
EU Investigates Grok AI for Generating Child Sexual Abuse Deepfakes
stiripesurse.ro
EU Investigates Grok AI for Generating Child Sexual Abuse Deepfakes
Oct 2026AI deepfakes and harassment campaigns target Nigerian women, report warnsReportedHarmful and abusive contentPremium Times NigeriaLeadershipSep 2026UK ASA bans AI app ads for objectification and explicit contentConfirmedHarmful and abusive contentBBCAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNow