Skip to content
Submit incident
AII-1000-96393
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Grok AI generates non-consensual sexualized images of minors and women

Grok's image editing feature enabled non-consensual sexual modification of images posted on X, reportedly generating approximately 6,700 sexualized images per hour. Multiple countries including Indonesia, India, France and Malaysia have launched investigations or blocked access to Grok in response.

December 2025 · xAI · Harmful and abusive content
December 2025
AII-1000-963937 sources ↓
Quick facts
Category
Harmful and abusive content
Country
Indonesia
Source
ITmedia AI+
Date
December 2025
Drafted by
Raidu Incident Detection

What happened

In late December 2025, xAI's Grok image editing feature became more accessible on X, allowing users to edit images from X posts directly. The feature enabled modification of others' posted images, including sexual manipulation, without the original poster's consent.

Users reportedly used Grok to generate sexualized versions of images of children and women posted on X. According to reports, Grok generated approximately 6,700 sexualized images per hour, with 85% of all images generated on Grok being sexual in nature.

Reported impact

Creators expressed concern about posting images on X due to the ease of sexual modification. Content creators reportedly stated they found it difficult to share artwork on the platform as a result of the feature.

Indonesia's Minister of Communication and Digital Affairs stated that the government viewed non-consensual sexual deepfakes as serious violations of citizens' rights, dignity and safety in digital spaces.

Index analysis

xAI restricted Grok's image editing feature to paid subscribers on January 9, 2026. The feature was modified to prohibit sexual modifications including bathing suit, underwear and nude alterations.

Governance controls

Indonesia became the first country to block access to Grok on January 10, 2026. India, France, Malaysia, the United Kingdom and Australia launched investigations or announced concerns about the platform.

United States politicians sent an open letter to Apple and Google CEOs requesting removal of Grok and X applications from their app stores due to large-scale generation of illegal sexual imagery.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Indonesia
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological, Public interest
Harmed
Children, Women, General public
Failure modes
Deepfake image, Content moderation failure
Consequences
Regulatory investigation, System suspension or termination
AI systems
Grok
Regulations
EU AI Act (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

ITmedia AI+
「X投稿画像がGrokで他人に編集される」防止ツール「ピクシールド」 個人開発者が公開
8 January 2026
GIGAZINE
インドネシアがGrokへのアクセスをブロックした最初の国に、合意のない性的画像の拡散が理由
11 January 2026
KWP News/九州と世界のニュース
コラム:ディープフェイクと人権侵害
11 January 2026
afpbb.com
インドネシア「Grok」へのアクセス遮断 性的画像生成問題
11 January 2026
Arab News
マスク氏のAIボット「Grok」、反発を受けてXでの画像生成を有料ユーザーに制限
11 January 2026
西日本新聞me
投稿画像、性的にAI加工 Xで拡大、手軽さ一因 各国政府が問題視
11 January 2026
gizmodo.jp
「脱がせる」機能でGrok炎上、他サイトの85倍のスピードで生成されている
12 January 2026
Oct 2026Mexico's Women's Ministry Condemns Grok for Generating Non-Consensual Sexual ImagesConfirmedHarmful and abusive contentHora Cero WebEl UniversalAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.com