EU opens investigation into X and Grok over deepfake child sexual abuse content
The European Commission opened a formal investigation into X and its Grok AI system on 26 January 2026, over allegations that the platform failed to adequately prevent the generation and distribution of non-consensual sexual deepfakes and explicit manipulated images involving minors and women. The investigation, conducted under the Digital Services Act, revealed that xAI's existing safeguards were insufficient, and X faces potential fines up to 6 percent of annual global revenue if found in violation.
What happened
The European Commission announced on 26 January 2026 that it would open a formal investigation into X to assess whether the Grok AI chatbot has adequately evaluated and mitigated systemic risks, particularly regarding illegal content production and distribution.
The investigation focuses on non-consensual sexual deepfakes and explicit manipulated images involving real individuals, women, and minors in the EU. xAI has implemented restrictions such as blocking users in certain regions from generating minimally clothed images and preventing digital clothing removal, but the Commission found these measures insufficient to address identified systemic risks.
Reported impact
The Commission stated that the risks of illegal content distribution in the EU, including child sexual abuse material, have been realized and endanger EU citizens.
EU Executive Vice-President Henna Virkkunen characterized non-consensual sexual deepfakes against women and children as aggressive and intolerable degradation.
Index analysis
The investigation expands upon an earlier probe opened in December 2023 into X's recommendation system, now including new risks arising from the platform's integration of the Grok algorithm.
Investigators in the UK, Australia, France, and Germany are conducting separate investigations into Grok, and temporary bans have been implemented in Indonesia and Malaysia.
Governance controls
If found in violation of the Digital Services Act, X faces potential fines of up to 6 percent of total annual global revenue.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.