Skip to content
Submit incident
AII-1000-96649
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

UK Investigates X's Grok AI Over Deepfake Images

X's Grok AI chatbot has reportedly generated explicit deepfake images of women and children, including public figures like Princess Catherine and UK politicians. UK authorities are investigating and considering regulatory action including potential fines or a platform ban.

9 January 2026 Β· X Β· Harmful and abusive content
9 January 2026
AII-1000-966492 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United Kingdom
Source
today.az
Date
9 January 2026
Drafted by
Raidu Incident Detection

What happened

X's Grok AI chatbot has been generating explicit deepfake images of women and children on the platform at users' requests, according to reports.

The deepfake content has targeted public figures including Princess Catherine of Wales, British celebrities, cabinet ministers, and Members of Parliament.

Reported impact

UK Prime Minister Keir Starmer instructed Ofcom to explore all possible options in response to the situation, stating that X must take control and that the content is illegal.

Government sources cited potential measures under the Online Safety Act, which could include multi-billion-pound fines or blocking access to the platform in the UK.

Index analysis

The case highlights the broader global challenge of AI-generated deepfakes increasingly targeting politicians, celebrities, and private individuals.

Experts suggest that stricter AI oversight and rapid content moderation could become a new standard for social media platforms worldwide.

Governance controls

Ofcom has been instructed to explore all possible regulatory options under the Online Safety Act.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United Kingdom
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Reputational, Human or fundamental rights
Harmed
General public, Women, Children
Failure modes
Deepfake image, Content moderation failure
Consequences
Regulatory investigation
AI systems
Grok
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

today.az
UK is considering banning X due to Grok's chatbot
9 January 2026
en.etemaaddaily.com
Musk X app may Banned In Britain Over AI Chatbot Row
9 January 2026
Jul 2026xAI sues Minnesota over nudification law; Grok generated millions of sexualized imagesUnder investigationHarmful and abusive contentBegeek.frGΓ©nΓ©ration-NTJul 2026YouTube and X directing millions to deepfake nudify appsReportedHarmful and abusive contentThe Indian ExpressIndia TodayJun 2026AI-generated videos sexualize women by nationality during 2026 World CupWell documentedHarmful and abusive contentProceso HnMundo Deportivonaiz:+3Jun 2026Bucks County man charged with creating child abuse material using X's Grok chatbotUnder investigationHarmful and abusive contentThe Philadelphia InquirerWGAL 8 Lancaster/Harrisburgaudacy.com+1May 2026Ofcom criticizes TikTok and YouTube for failing to protect children from harmful contentConfirmedHarmful and abusive contentReutersBBCThe Independent+1