Malaysia Restricts Grok AI Tool Over Harmful Content Generation
Malaysia's Communications and Multimedia Commission temporarily restricted access to X's Grok AI tool after reports that its image and video generation features were being misused to create sexually explicit content. X subsequently confirmed restrictions had been implemented and committed to working with Malaysian authorities on content moderation.
What happened
Malaysia's Communications and Multimedia Commission announced on January 13 that it would temporarily restrict users from accessing Grok, X's AI chatbot tool, citing repeated misuse to generate pornographic and sexually explicit content.
On January 21, X representatives met with Malaysia's Communications Minister and confirmed that Grok's image editing and video generation functions had been placed under restrictions, preventing users from generating sexually explicit material.
Reported impact
X stated it would implement a zero-tolerance policy towards any content involving child sexual abuse and non-consensual nudity, and would remove violating content and take action against accounts breaking platform rules.
Index analysis
Grok's image generation and video editing features were reportedly being abused to create non-consensual sexual imagery without adequate safeguards in place.
Governance controls
X committed to working with Malaysia's Communications Ministry and the Communications and Multimedia Commission to ensure platform safety and prevent harmful content distribution.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.