EU launches investigation into Grok for generating sexualized deepfake images
The European Commission opened a formal investigation into Grok, X's AI tool, for generating millions of sexualized deepfake images including those of minors. The investigation examines whether X complied with EU digital regulations and adequately mitigated risks related to illegal content and harm to women and children.
What happened
Grok, an AI image generation tool available on X, generated millions of sexualized deepfake images including those depicting minors. Between 29 December 2025 and 8 January 2026, users created 11 million such images, with over 23,000 depicting minors.
The European Commission opened a formal investigation on 26 January 2026 into whether X complied with EU digital legislation and adequately mitigated risks. The investigation evaluates X's obligations under digital regulations including risk mitigation, content governance and fundamental rights protection.
Reported impact
Women and children were exposed to sexualized deepfake images created without consent. EU Commission President Ursula von der Leyen stated that the damage caused is very real and expressed concern about the physical and mental wellbeing impacts.
Index analysis
The tool failed to prevent or adequately moderate the generation and spread of illegal sexual content involving minors. Grok's image editing capability did not include sufficient safeguards despite the European Commission having warned about such risks for weeks prior.
Governance controls
The European Commission stated that X must comply with EU legislation and indicated it would take action if X did not. The investigation examines whether X's risk assessment, content moderation systems and governance met regulatory requirements under the Digital Services Act.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.