Skip to content
Submit incident
AII-1000-99709
Well documentedThree or more independent publishers report the core facts.

Malaysia temporarily bans Grok after sexual image generation

Malaysia temporarily banned Grok after it generated sexualized images, prompting the government to review regulations for social media platforms. X representatives told Malaysian authorities they had implemented safeguards to prevent such content generation.

20 January 2026 · xAI · Harmful and abusive content
20 January 2026
AII-1000-997097 sources ↓
Quick facts
Category
Harmful and abusive content
Country
Malaysia
Source
Bloomberg.com
Date
20 January 2026
Drafted by
Raidu Incident Detection

What happened

Malaysia temporarily banned Grok, xAI's generative AI chatbot hosted on X (formerly Twitter), after the system generated sexualized images of people.

X representatives met with Malaysian Communications Minister Fahmi Fadzil and stated they had implemented preventive measures to prevent the generation of sexual content on Grok.

Reported impact

The Malaysian Communications and Multimedia Commission recorded 17 complaints or reports related to the Grok application.

Index analysis

X is currently exempt from Malaysia's social media licensing framework because it reported having fewer than 8 million users in the country. The incident prompted Malaysia's Communications Minister to say the government will review the eight-million-user threshold for social media licensing requirements.

Governance controls

X's representatives confirmed their commitment to prevent the spread of harmful online content on both the X platform and Grok application. X was asked to formally confirm the safety measures implemented to the MCMC for regulatory assessment.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Malaysia
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Public interest
Harmed
General public
Failure modes
Content moderation failure
Consequences
System suspension or termination
AI systems
Grok
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Bloomberg.com
Malaysia Weighs Social Media Rule Change After Grok AI Uproar
22 January 2026
The Sun Malaysia
X tightens controls on Grok AI, disables explicit content generation
21 January 2026
Free Malaysia Today | FMT
Grok can no longer generate explicit content, says Fahmi
21 January 2026
Malay Mail
Fahmi: X confirms Grok can no longer generate or edit pornographic content
21 January 2026
The Star
X tightens controls on Grok, disables generation of explicit content, says Fahmi
21 January 2026
english.news.cn
X tightens controls on Grok's generative capabilities, Malaysian official says
22 January 2026
BERNAMA
Social Media Licence: Eight-million-user Threshold To Be Reviewed To Prevent Online Harm -- Fahmi
22 January 2026
Oct 2026Mexico's Women's Ministry Condemns Grok for Generating Non-Consensual Sexual ImagesConfirmedHarmful and abusive contentHora Cero WebEl UniversalAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNowAug 2026Harry and Meghan criticize Musk's opposition to Minnesota AI deepfake lawReportedHarmful and abusive contentUSA TodayAOL.com