Skip to content
Submit incident
AII-1000-98301
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Indonesia blocks Grok AI over deepfake pornography concerns

Indonesia's Ministry of Communication and Digital blocked Grok AI after it was used to create pornographic deepfake images from real photographs. X subsequently contacted the regulator and announced restrictions preventing Grok from generating such content and limiting the tool to paid users.

14 January 2026 · xAI · Harmful and abusive content
14 January 2026
AII-1000-983012 sources ↓
Quick facts
Category
Harmful and abusive content
Country
Indonesia
Source
detikinet
Date
14 January 2026
Drafted by
Raidu Incident Detection

What happened

Indonesia's Ministry of Communication and Digital (Komdigi) blocked Grok AI after the tool enabled users to create pornographic content from real photographs.

X contacted Komdigi to discuss the block and the restoration of access.

Reported impact

Grok was used to produce pornographic content sourced from real photographs of people.

Index analysis

Elon Musk's xAI announced through X's safety platform that Grok would no longer produce pornographic content from real photographs.

Grok features became restricted to paid users to enable enforcement against users violating laws.

Governance controls

xAI implemented restrictions preventing Grok from generating pornographic content from real photographs.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Indonesia
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Human or fundamental rights
Harmed
General public, Women
Failure modes
Deepfake image
Consequences
System suspension or termination
AI systems
Grok

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

detikinet
X Hubungi Komdigi Bahas Nasib Grok AI Diblokir Gegara Konten Mesum
14 January 2026
20DETIK
Video: Akhirnya! Grok Kini Gak Bisa Dipakai Edit Foto Pornografi Lagi di X
15 January 2026
Oct 2026Mexico's Women's Ministry Condemns Grok for Generating Non-Consensual Sexual ImagesConfirmedHarmful and abusive contentHora Cero WebEl UniversalAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.com