EU criticizes X's Grok for generating sexual deepfakes of women and children
X's AI chatbot Grok was reportedly used to create and distribute sexually explicit deepfake images of women and children without consent. European regulators, including the Commission and the UK's Ofcom, launched investigations and the Commission ordered X to preserve documentation related to the system.
What happened
The platform X, owned by Elon Musk, distributed sexually explicit deepfake images of women and children created using its AI chatbot Grok.
The European Commission ordered X to preserve all internal documents and data related to Grok. The British regulator Ofcom launched a formal investigation into X regarding sexually explicit images distributed by Grok, including nude images that may constitute intimate image abuse or pornography, and sexually explicit images of children that may constitute child sexual abuse material.
Reported impact
European Commission President Ursula von der Leyen stated she was appalled that the technology platform enabled "digital stripping of women and children online" and that the harm caused by deepfakes is very real.
Index analysis
The incident involves the use of generative AI to create non-consensual sexual imagery of real people without their knowledge or consent.
Governance controls
The European Commission required X to retain documentation related to Grok and has labeled such controversial images as illegal. Regulators in Brussels, Paris, and London initiated investigations in response to multiple reports of abuse of Grok for creating pornographic and violent deepfakes.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.