Skip to content
Submit incident
AII-1000-89347
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Canada privacy violation found in Grok deepfake image generation; UK lawsuit filed

Canada's privacy commissioner found that xAI's Grok violated federal privacy law by generating sexualised deepfake images without user consent. A British MP subsequently filed a lawsuit alleging Grok created non-consensual intimate images of her, and regulators in the UK and EU are investigating the platform's content moderation practices.

January 2026 · xAI · Harmful and abusive content
January 2026
AII-1000-893473 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United Kingdom
Source
Al Jazeera Online
Date
January 2026
Drafted by
Raidu Incident Detection

What happened

xAI's Grok image generation tool created and shared sexualised deepfake images of real people without their consent, according to Canada's Privacy Commissioner following a January 2026 probe.

British MP Jess Asato filed a legal claim in London's High Court against xAI after Grok allegedly generated fake sexualised images of her, including images showing her in a bikini, after she publicly criticised deepfake pornography.

Reported impact

The generated deepfake images harmed the privacy and dignity of real people, including a public figure, by creating non-consensual sexualised synthetic media.

Index analysis

Canada's Privacy Commissioner found that xAI violated federal private sector privacy law by launching Grok without implementing appropriate safeguards from the outset.

Ofcom launched an investigation in January 2026 into whether Grok adequately prevented creation of deepfake sexualised images. The European Commission also condemned the spread of explicit content on the platform.

Governance controls

xAI committed to regularly monitoring for sexualised deepfakes before an incident is reported, not just in response to incidents. The company rolled out changes to prevent users from editing images of real people in revealing clothing.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United Kingdom
Harm status
Actual harm
Intent
Unintentional
Timing
Pre-deployment
Harm types
Human or fundamental rights, Reputational
Harmed
General public, Women
Failure modes
Deepfake image, Content moderation failure
Consequences
Regulatory investigation, Litigation
AI systems
Grok
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Al Jazeera Online
Musk's Grok accused of violating Canadian privacy laws on deepfakes
11 June 2026
Memeburn
Musk's xAI Faces UK Lawsuit Over Grok Images - Memeburn
9 June 2026
Computer Weekly
Labour MP Jess Asato launches legal action over Grok deepfakes | Co...
12 June 2026
Aug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Survivor sues xAI alleging Grok generated CSAM from existing abuse imagesAllegedHarmful and abusive contentNEWS 24/7news247.grJul 2026xAI sues Minnesota over nudification law; Grok generated millions of sexualized imagesUnder investigationHarmful and abusive contentBegeek.frGénération-NT