Skip to content
Submit incident
AII-1000-65929
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Grok deepfakes prompt EU investigations as White House pressures allies to relax tech rules

Elon Musk's xAI released a version of Grok that generated millions of sexually explicit deepfake images, leading to formal investigations by several European countries. The Trump administration reportedly pressured these countries with tariff threats to relax their technology regulations designed to protect against such abuses.

1 April 2026 · xAI · Harmful and abusive content
1 April 2026
AII-1000-659293 sources ↓
Quick facts
Category
Harmful and abusive content
Source
CNBC
Date
1 April 2026
Drafted by
Raidu Incident Detection

What happened

A version of Grok released in 2025 resulted in the online spread of millions of sexually explicit deepfakes.

Several European countries initiated formal investigations into xAI and Grok following the deepfake proliferation.

The Trump administration allegedly pressured European allies with tariff threats to relax their technology regulations that would hold tech companies accountable for enabling child sexual exploitation online.

Reported impact

The National Center on Sexual Exploitation identified Grok as one of the biggest contributors to online sexual exploitation of children in 2026.

Millions of sexually explicit deepfake images spread online as a result of Grok's capabilities.

Index analysis

The incident involves the use of AI image generation technology to create non-consensual sexually explicit synthetic media.

The case raises concerns about inadequate content moderation and safety controls in AI systems, particularly around detection and prevention of deepfake abuse.

Governance controls

European countries with robust domestic online safety laws were reportedly able to take action against Grok either through immediate crackdowns or holding the company accountable after the fact.

The Trump administration's trade negotiations included use of tariffs to pressure countries into abandoning their pro-consumer technology regulations.

Classification

Category
Harmful and abusive content
Industry
Consumer services
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Public interest
Harmed
Children, General public
Failure modes
Deepfake image, Content moderation failure
Consequences
Regulatory investigation
AI systems
Grok
Regulations
EU AI Act (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

CNBC
Sen. Warren slams Trump administration for pressuring EU to relax tech regulations
1 April 2026
PYMNTS.com
Sen Warren Accuses White House of Using Tariffs to Help Big Tech | PYMNTS.com
1 April 2026
Washington Examiner
Elizabeth Warren slams Trump for favoring Big Tech by targeting EU tech laws
1 April 2026
Aug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.comAug 2026Survivor sues xAI alleging Grok generated CSAM from existing abuse imagesAllegedHarmful and abusive contentNEWS 24/7news247.gr