Skip to content
Submit incident
AII-1000-96823
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Indonesia blocks Grok over deepfake pornography risks

Indonesia temporarily blocked access to Grok, Elon Musk's AI chatbot, after users exploited its image generation feature to create non-consensual sexual images of real people. The move made Indonesia the first country to impose a comprehensive ban on the system over deepfake pornography risks.

10 January 2026 · xAI · Harmful and abusive content
10 January 2026
AII-1000-968232 sources ↓
Quick facts
Category
Harmful and abusive content
Country
Indonesia
Source
TVBS
Date
10 January 2026
Drafted by
Raidu Incident Detection

What happened

Grok's image generation feature allowed users to create non-consensual sexual images of women and children by processing their photographs with simple instructions.

Some X platform users generated fake sexually explicit content of real people and shared it on the platform, affecting hundreds of adult women and minors.

On January 10, 2026, Indonesia's Ministry of Communications and Digital Affairs temporarily blocked access to Grok, becoming the first country to impose a comprehensive ban.

Reported impact

The government stated it sought to protect women, children and the public from risks of AI-generated fake pornographic content.

Officials said non-consensual deepfakes seriously violated human rights, dignity and citizens' digital space security.

Index analysis

Other regions restricted Grok access to paying subscribers in response to the controversy, but Indonesia imposed a full block.

European officials and technology advocates criticized limiting the tool to paid users as insufficient to address social concerns about sexually explicit deepfakes.

Governance controls

Indonesia's Ministry of Communications and Digital Affairs summoned representatives of the X platform to explain the situation.

Elon Musk responded to a post about the issue, stating that anyone using Grok to create illegal content would face the same legal consequences as those uploading illegal material.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Indonesia
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological
Harmed
General public, Women, Children
Failure modes
Deepfake image, Content moderation failure
Consequences
System suspension or termination
AI systems
Grok

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

TVBS
憂AI產出深偽不雅圖 印尼暫封鎖Grok成全球首例│TVBS新聞網
10 January 2026
21jingji.com
Indonesia blocks Grok over deepfake pornography risks
Oct 2026AI deepfakes and harassment campaigns target Nigerian women, report warnsReportedHarmful and abusive contentPremium Times NigeriaLeadershipSep 2026UK ASA bans AI app ads for objectification and explicit contentConfirmedHarmful and abusive contentBBCAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNow