EU investigates X's Grok AI for generating sexual deepfakes
The European Commission launched an investigation into X in January 2026 over allegations that its Grok AI tool was used to generate sexual deepfakes and other sexualised images of real people. The UK regulator Ofcom also opened a separate investigation, and X stated it had restricted the tool's ability to remove clothing from images in jurisdictions where such content is illegal.
What happened
The European Commission launched an investigation into X over concerns its AI tool Grok was used to create sexualised images of real people. This follows a similar announcement in January from the UK watchdog Ofcom.
X's Safety account previously stated the social media platform had stopped Grok from digitally altering pictures of people to remove their clothing in 'jurisdictions where such content is illegal'. The Grok account on X claimed more than 5.5 billion images were generated by the tool in just 30 days.
Reported impact
Henna Virkkunen, Executive Vice-President for Tech Sovereignty, Security and Democracy at the Commission, called the sexual deepfakes a 'violent, unacceptable form of degradation'. Campaigners and victims said the ability to generate sexually explicit pictures using the tool should have 'never happened'.
Index analysis
Regina Doherty, a member of the European parliament representing Ireland, said the Commission would assess whether 'manipulated sexually explicit images' have been shown to users in the EU. The EU regulator said it may 'impose interim measures' if X refuses to implement meaningful adjustments.
If X is found to have breached the rules of the EU's Digital Services Act, the Commission could fine the company up to 6% of its global annual turnover. Other investigations into the platform's chatbot are underway in Australia, France and Germany.
Governance controls
A previous statement from X's Safety account said the social media platform had stopped Grok from digitally altering pictures of people to remove their clothing in 'jurisdictions where such content is illegal'. Grok was temporarily banned in Indonesia and Malaysia, although Malaysia has since lifted the ban.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.