Skip to content
Submit incident
AII-1000-95979
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Indonesia Blocks Grok AI Over Non-Consensual Sexual Deepfake Content

Indonesia's Ministry of Communication and Digital suspended access to Grok, an AI feature integrated into platform X, on January 10, 2026, citing concerns that the tool was being used to generate non-consensual sexual deepfake images targeting women and children. The government characterized such use as a serious violation of human rights and digital safety.

10 January 2026 Β· Grok Β· Harmful and abusive content
10 January 2026
AII-1000-959792 sources ↓
Quick facts
Category
Harmful and abusive content
Country
Indonesia
Source
ototekno.harianjogja.com
Date
10 January 2026
Drafted by
Raidu Incident Detection

What happened

On January 10, 2026, Indonesia's Ministry of Communication and Digital temporarily blocked access to Grok, an AI feature accessible through platform X, citing concerns about its use to generate non-consensual sexual deepfake content.

Minister Meutya Hafid stated the government viewed non-consensual sexual deepfake practices as serious violations of human rights, dignity, and digital safety for women, children, and citizens. The ministry requested platform X provide clarification regarding Grok's negative impacts and mitigation steps to prevent future misuse.

Reported impact

The use of AI technology to create and distribute fake pornographic content without the consent of those depicted was characterized as a form of digital sexual violence with psychological, social, and legal impacts on victims.

Index analysis

The block was described as preventive and corrective in nature. The Ministry of Communication and Digital cited its authority under Regulation of the Ministry of Communication and Informatics Number 5 of 2020 on Private Electronic System Operators, specifically Article 9, which requires electronic system operators to ensure systems do not contain, facilitate, or distribute prohibited electronic information.

Governance controls

The suspension was temporary and intended to allow platform X and the government to establish adequate security mechanisms to prevent future misuse of the technology.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Indonesia
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological
Harmed
Women, Children, General public
Failure modes
Deepfake image, Content moderation failure
Consequences
System suspension or termination
AI systems
Grok

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

ototekno.harianjogja.com
Indonesia Blocks Grok AI Over Non-Consensual Sexual Deepfake Content
tekno.sindonews.com
Indonesia Blocks Grok AI Over Non-Consensual Sexual Deepfake Content