Malaysia Bans Grok AI Over Generation of Explicit Content
Malaysia's communications authority banned access to Grok, an AI chatbot, due to its use in generating explicit sexual content and revealing images. X responded by implementing technical restrictions and geographic blocking to prevent such content generation.
What happened
Grok, an AI chatbot owned by xAI and deployed on X, was used to generate explicit sexual content and images of people in revealing clothing.
Malaysia's Malaysian Communications and Multimedia Authority (MCMC) imposed a temporary ban on access to Grok within the country due to the generation of pornographic and obscene sexual content.
Reported impact
The controversy prompted multiple governments and women's and children's rights organizations globally to call for Apple and Google to remove the application.
Indonesia temporarily banned Grok the previous week due to concerns it could generate pornographic content.
Index analysis
X implemented technical measures to prevent Grok from generating or editing images of real people wearing bikinis or other revealing clothing, applicable to all users including paid subscribers.
Grok's image generation and editing functions on X were restricted to paid subscription users only to increase traceability and reduce risk of misuse.
X stated it would implement geographic blocking in jurisdictions where such content generation is prohibited by law, operate 24/7 to enhance protective measures, remove violating and illegal content, and permanently ban accounts when necessary while cooperating with local governments and law enforcement.
Governance controls
X's safety team stated implementation of technical measures and ongoing 24/7 work to strengthen protective safeguards, remove violations and illegal content, and permanently suspend accounts when necessary while cooperating with local governments and enforcement agencies.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.