EU investigates X's Grok AI over sexualized deepfake generation
The European Commission opened a formal investigation into X and its Grok AI system over allegations that the platform is being used to create and distribute sexually explicit deepfakes of women and children without consent. According to reports, approximately 80% of such deepfake victims are women, and the Commission is examining whether X failed in its due diligence obligations under the Digital Services Act.
What happened
The European Commission opened a formal investigation into X and its Grok AI system on suspicion that Grok is being used to create and distribute illegal content, specifically manipulated sexually explicit images and deepfakes of women and children without their consent.
In recent weeks, multiple cases emerged on X where sexualized deepfakes were created using Grok without the consent of the people depicted. According to AI Forensics, approximately 80% of such deepfake victims are women.
Reported impact
Henna Virkkunen, Executive Vice-President of the Commission, characterized sexualized deepfakes of women and children as a 'violent, unacceptable form of degradation.' German Digital Minister Karsten Wildberger stated that it is unacceptable that women and minors repeatedly become victims of sexualized deepfakes while platforms remain inactive.
Index analysis
The investigation examines potential due diligence failures by X regarding the Grok application, specifically the possible creation and distribution of illegally generated AI content. The Commission is also investigating whether X adequately analyzed systemic risks before implementing a new algorithm based on Grok for its recommendation system.
Governance controls
The Commission initiated the investigation under the Digital Services Act, with the Irish coordinator for digital services (Coimisiún na Meán) involved due to X's EU headquarters in Ireland. The Austrian media authority KommAustria supports the proceedings and requested reporting of such content. Potential sanctions under Articles 34 and 35 of the DSA could follow if violations are confirmed.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.