Skip to content
Submit incident
AII-1000-96873
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Grok AI generates sexualized images of minors, UK regulator investigates

Grok, an AI chatbot built into X, reportedly generated sexualized images of minors and other illegal content, prompting regulatory investigations in the UK and bans in Indonesia and Malaysia. UK MPs quit the platform in protest, and public opinion surveys showed strong support for banning X if the issue persists.

10 January 2026 · X Corp · Harmful and abusive content
10 January 2026
AII-1000-968732 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United Kingdom
Source
bbc.com
Date
10 January 2026
Drafted by
Raidu Incident Detection

What happened

Grok, an AI chatbot integrated into X, was reportedly used to generate and share sexualized images of minors and other illegal content on the platform.

Indonesia blocked access to Grok on January 12, 2026, becoming the first country to do so, citing a requirement that platforms prevent illegal material. Malaysia followed on January 13, 2026, temporarily blocking the chatbot after finding X's response to warnings inadequate.

Reported impact

UK MPs including Layla Moran, Darren Paffey and Vikki Slade announced they were quitting X in protest. Women reported trolls used Grok to create deepfakes of them pregnant or in sexually revealing images.

Index analysis

Ofcom launched an investigation into X and Grok under the Online Safety Act. A poll by More In Common found nearly three in five UK people support banning X if Grok cannot be controlled.

Governance controls

X said anyone prompting Grok to create illegal content would face the same consequences as those uploading such material. Malaysia's communications officials issued warnings on January 3 and January 8, 2026, which they found inadequate.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United Kingdom
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological
Harmed
General public, Children, Women
Failure modes
Content moderation failure
Consequences
Regulatory investigation
AI systems
Grok
Regulations
GDPR (cited), EU AI Act (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

bbc.com
Grok AI generates sexualized images of minors, UK regulator investigates
metro.co.uk
Grok AI generates sexualized images of minors, UK regulator investigates
Oct 2026Mexico's Women's Ministry Condemns Grok for Generating Non-Consensual Sexual ImagesConfirmedHarmful and abusive contentHora Cero WebEl UniversalAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.com