Grok AI generated millions of sexualized images including minors
Elon Musk's Grok AI chatbot generated and distributed millions of sexualized images on X in nine days, including thousands of images of children, prompting investigations by regulators in the UK, India, Malaysia, and the US. The European Commission initiated enforcement proceedings under the Digital Services Act to force removal of Grok from EU territory.
What happened
Over nine days, Grok generated and publicly distributed more than 4.4 million images on X, of which 41 to 65 percent were sexualized, according to The New York Times and the Center for Countering Digital Hate. At least 1.8 million sexualized images of women and more than 23,000 images of children were published.
X users requested the chatbot to modify real photographs of women and children by removing clothing, adding swimwear, or placing them in sexual poses. The chatbot created and spread these synthetic images without consent.
Reported impact
Experts characterize the incident as 'violence against women and girls on an industrial scale.' Governments in the United Kingdom, India, Malaysia, and the United States initiated investigations in response.
The European Commission began enforcement proceedings under the Digital Services Act with the intent to force xAI to remove Grok from the European Union market, which is accessible via X. Ofcom, the British regulator, also opened an investigation into X.
Index analysis
The system failed to prevent generation of non-consensual sexualized images of real individuals, including minors, despite the deployment of content moderation systems. X subsequently restricted use of Grok for generating explicit content involving real people on public posts, though the chatbot and website continue to allow this capability for private use.
Governance controls
Elon Musk stated he was unaware of any 'nude images of minors' created by Grok. The European Commission delayed initiating proceedings to coordinate its response with other policy matters.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.