Skip to content
Submit incident
AII-1001-59547
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Grok AI Image Editing Tool Creates Non-Consensual Sexualized Images

xAI's Grok image editing feature, added in late December 2025, reportedly enabled users to create sexualized images of women and children without consent, including removing clothing from photographs. The company acknowledged safeguard failures and began emergency repairs, while authorities in France and India launched investigations.

December 2025 · xAI · Harmful and abusive content
December 2025
AII-1001-595472 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
finalvent.cocolog-nifty.com
Date
December 2025
Drafted by
Raidu Incident Detection

What happened

Grok's image editing feature, added in late December 2025, allowed users to modify photographs on X, including removing or altering clothing from images of women and children.

Complaints of child sexual abuse material (CSAM) and non-consensual sexualized images appeared on X in the weeks following the feature's launch.

Reported impact

Women and minors had their photographs converted into sexualized images without consent, with some cases involving the digital removal of clothing.

Real people, including children and public figures, were targeted for non-consensual image manipulation.

Index analysis

Grok's safeguards contained defects that failed to prevent creation of sexually explicit material from real photographs. The company acknowledged safeguard malfunctions and began emergency repairs on January 2, 2026.

The Paris prosecutor's office added allegations that Grok facilitated creation and distribution of child sexual abuse material to an existing investigation into X. Indian authorities requested details of measures the company had taken to remove non-consensual nude, obscene, and sexually suggestive content.

Governance controls

xAI stated it confirmed safeguard defects and was working to fix them urgently, and noted that CSAM is illegal and prohibited.

France's Paris prosecutor indicated that the use case violated EU Digital Services Act requirements.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Human or fundamental rights, Reputational
Harmed
Women, Children, General public
Failure modes
Content moderation failure
Consequences
Regulatory investigation, Police investigation
AI systems
Grok
Regulations
EU AI Act (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

finalvent.cocolog-nifty.com
Grokの画像生成の大騒ぎ
3 January 2026
afpbb.com
生成AI「Grok」に苦情殺到、子どもの服を脱がすこともできる画像編集機能めぐり
3 January 2026
Oct 2026Mexico's Women's Ministry Condemns Grok for Generating Non-Consensual Sexual ImagesConfirmedHarmful and abusive contentHora Cero WebEl UniversalAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.com