EU and Brazil investigate X's Grok for generating sexualized deepfake images
X's Grok AI chatbot allowed users to generate sexualized deepfake images of women and children. The EU Commission opened a formal investigation in January 2026, alleging X failed to assess and mitigate risks including harm to minors, and Brazil also reportedly opened an inquiry.
What happened
Grok users could manipulate photos of women and children by requesting the chatbot to digitally alter them into sexualized outfits or bikinis. At New Year, the company apologized for creating and sharing an image of two teenage girls in sexualized outfits.
Reported impact
The EU Commission opened an investigation on 26 January 2026 after the scandal became public, stating that X had not adequately assessed and mitigated risks including gender-based violence and harm to physical and mental wellbeing. The UK and France also launched investigations, with France additionally examining allegations of Holocaust denial and promotion of extremist content.
Index analysis
In response, X restricted image generation to paying users only and implemented new technical safeguards to prevent sexualized depictions of real people. However, regulators found these measures insufficient.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.