Skip to content
Submit incident
AII-1000-95973
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Indonesia suspends Grok access over AI-generated explicit deepfake content

Indonesia's Ministry of Communications and Digital Affairs temporarily suspended access to Grok, an AI chatbot by xAI, on January 11, 2026, after the system was reportedly used to generate non-consensual sexual deepfake images. The ministry cited concerns that AI-generated explicit imagery violated human rights and digital security, and requested clarification from X platform on the harmful impacts of Grok's use.

11 January 2026 · xAI · Harmful and abusive content
11 January 2026
AII-1000-959732 sources ↓
Quick facts
Category
Harmful and abusive content
Country
Indonesia
Source
Haber Aktüel - Reklamsız Haber Sitesi ve Haberler Uygulaması
Date
11 January 2026
Drafted by
Raidu Incident Detection

What happened

Indonesia's Ministry of Communications and Digital Affairs temporarily blocked access to Grok, an AI chatbot developed by xAI, on January 11, 2026, citing concerns over the generation and dissemination of sexualized images including non-consensual deepfake content.

The ministry based the action on Ministerial Regulation No. 5 of 2020 on Private Electronic System Providers, particularly Article 9, which requires providers to ensure their systems do not contain, facilitate, or disseminate prohibited electronic information.

Reported impact

The ministry stated the move was necessary to protect women, children, and the public from harm linked to AI-generated explicit imagery that officials view as a serious violation of human rights and digital security.

Requests to generate sexually explicit deepfake content featuring images of celebrities and unknown individuals using Grok became a social media trend on X, prompting reactions from the United Kingdom and other countries.

Index analysis

The EU Commission stated on January 5, 2026 that it was taking the matter seriously and was in the evaluation phase.

Malaysia emphasized on January 3, 2026 that X bore responsibility for preventing the spread of such harmful content. India issued X a directive for a comprehensive investigation into the matter.

Governance controls

Elon Musk, owner of X, stated on January 3, 2026 that users utilizing Grok to produce illegal content would be treated as if they had uploaded illegal content, but this did not prevent the escalation of concerns.

The ministry requested X to promptly provide clarification regarding the negative impacts arising from Grok's use.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Indonesia
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological
Harmed
Women, Children, General public
Failure modes
Deepfake image
Consequences
System suspension or termination
AI systems
Grok
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Haber Aktüel - Reklamsız Haber Sitesi ve Haberler Uygulaması
Endonezya'dan Grok'a Geçici Erişim Engeli Kararı - Haber Aktüel
10 January 2026
english.news.cn
Indonesia suspends Grok access over AI-generated explicit deepfake content
Oct 2026AI deepfakes and harassment campaigns target Nigerian women, report warnsReportedHarmful and abusive contentPremium Times NigeriaLeadershipSep 2026UK ASA bans AI app ads for objectification and explicit contentConfirmedHarmful and abusive contentBBCAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNow