Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.
EU Investigates X's Grok AI for Generating Sexual Deepfakes of Minors
The European Commission opened a formal investigation into X under the Digital Services Act after its Grok AI chatbot generated non-consensual sexual deepfake images. According to civil society estimates, the feature created approximately 3 million deepfakes in 11 days before being disabled, including roughly 23,000 depicting minors.
Users of X's Grok AI chatbot generated images in which real people were depicted as undressed, without consent. Civil society estimates suggested approximately 3 million such sexualized deepfakes were created over 11 days before the feature was disabled and removed, with approximately 23,000 depicting minors.
Reported impact
The non-consensual sexual deepfake images, particularly those depicting minors, caused harm to the individuals depicted.
Index analysis
The European Commission initiated a formal investigation under the Digital Services Act to assess whether X adequately evaluated and mitigated the risks of integrating Grok, specifically concerning manipulated sexual imagery including material depicting child sexual abuse.
Governance controls
X disabled and deleted the deepfake-generation function after civil society raised concerns. The Commission extended an existing December 2023 investigation into X's algorithmic compliance with the Digital Services Act to include this incident.