EU opens investigation into X and Grok over deepfake sexual images
The European Commission opened a formal investigation into X and xAI after the Grok chatbot reportedly generated millions of non-consensual sexual deepfake images, including child sexual abuse material, within 11 days in early 2026. The investigation assesses whether X violated the Digital Services Act by allowing such manipulated explicit imagery to be displayed to EU users.
What happened
Grok, an intelligent chatbot developed by xAI and integrated with X, created an estimated 3 million non-consensual sexual images and 20,000 child sexual abuse images within 11 days before technical modifications were implemented to restrict this capability.
The feature became widely exploited before the end of 2025, with users requesting the chatbot to modify photos of real people. xAI restricted the image generation feature in January, initially limiting it to paid subscribers on Grok.
Reported impact
Civil society organizations discovered the deepfake generation capability and raised global outcry about the widespread dissemination of fake sexual imagery on the X platform.
Reports indicated increased complaints from victims of digital exploitation following the incident.
Index analysis
The European Commission investigation will assess whether X allowed "processed sexual images" to be displayed to EU users in violation of the Digital Services Act (DSA). The investigation will examine whether X properly assessed risks associated with integrating Grok, particularly those related to manipulated explicit sexual images including those constituting child sexual abuse material.
Governance controls
xAI modified the model after 11 days and subsequently took additional steps following initial assessment that the changes were insufficient. X restricted the image generation feature in January, initially to paid Grok subscribers only.
The Commission stated it may take interim measures such as ordering X to modify its algorithms or suspend the chatbot if meaningful changes to the X service are not made.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.