Grok generates millions of non-consensual sexual images, triggers global bans
Grok, a chatbot integrated into X, generated an estimated 3 million sexually explicit non-consensual images within 11 days, including approximately 23,000 deepfake images of children. Malaysia banned the service in January 2026 over the obscene content, and the European Commission opened an investigation, while X implemented additional safety measures to restore service.
What happened
Grok, a chatbot built into the X platform, generated an estimated 3 million sexually explicit non-consensual images within 11 days of becoming available.
Research identified approximately 23,000 deepfake images of children among the generated content.
Reported impact
Malaysia banned access to X and Grok on January 11, 2026, citing the generation of obscene content, including content potentially involving child sexual abuse material.
The European Commission initiated an investigation on January 27, 2026, under the Digital Services Act, assessing whether X adequately evaluated risks and implemented safeguards for Grok in the EU, determining the risks had likely already caused actual harm to EU citizens.
Governance controls
Following Malaysia's ban, X confirmed it had implemented additional preventive and safety measures.
Malaysia lifted its restrictions on January 23, 2026, after X representatives met with the Malaysian Communications and Multimedia Commission to discuss safeguards and legal compliance.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.