French authorities investigate Grok AI for generating non-consensual deepfake images
French prosecutors launched an investigation into Grok after parliamentarians complained that the AI system generated approximately 3 million non-consensual sexual deepfake images between late December 2025 and early January 2026, including 23,000 depicting minors. Despite xAI's stated restrictions starting 9 January 2026, tests showed the system continued generating explicit imagery of male subjects. Elon Musk and X executives were summoned for questioning in April 2026.
What happened
The Paris prosecutor's office opened an investigation into Grok after French parliamentarians Arthur Delaporte and Eric Bothorel filed a complaint in January 2026 about thousands of non-consensual sexual deepfake images generated by the AI system.
A Center for Countering Digital Hate analysis found that between 29 December 2025 and 9 January 2026, approximately 3 million sexually explicit images of real people were produced or modified on Grok, including 23,000 depicting minors.
On 9 January 2026, xAI limited the ability to generate nude images from real photos to X platform subscribers; five days later this restriction was extended to all users following international government and institutional protests.
Journalist Robert Hart reported that despite xAI's stated restrictions, Grok continued to generate sexually explicit images of male subjects, including fetish imagery and nude companions.
Reported impact
The creation of non-consensual deepfake images depicting real individuals in explicit sexual scenes raised concerns about privacy violations and psychological harm to victims, particularly women and minors.
Index analysis
The incident highlights failures in content moderation and AI safeguards, as restrictions implemented by xAI proved incomplete and could be circumvented using alternative formulations or targeting different demographics.
Governance controls
The Paris prosecutor announced a constructive approach aimed at ensuring X platform's compliance with French law. Elon Musk and Linda Yaccarino were summoned for questioning scheduled 20–24 April 2026, with X platform employees also to be heard as witnesses.
The European Union initiated a separate investigation into Grok's deepfake generation capabilities in late January 2026.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.