Grok AI Generates Non-Consensual Nude Images of Women and Children
Grok, X's generative AI chatbot, enabled users to create non-consensual sexualized images of women and girls through its Imagine feature, which allowed editing of other users' posts. The capability spawned widespread creation of deepfake nude and sexually explicit images, including of minors as young as 11-13 years old, triggering investigations in multiple countries.
What happened
Grok's Imagine feature enabled users to request the AI system to generate new, edited versions of other users' posts, allowing creation of non-consensual sexualized images.
Criminals used this capability to generate nude and sexually explicit deepfake images of women and girls on the X platform, with victims reportedly as young as 11-13 years old.
Reported impact
The flood of non-consensual sexualized content generated by Grok attracted regulatory attention across multiple countries.
Victims included minors, and the content breached boundaries of legality in multiple jurisdictions.
Index analysis
The Imagine feature lacked sufficient content moderation to prevent generation of non-consensual sexual imagery.
The system did not detect or block requests to create deepfake nude images of specific individuals.
Governance controls
The European Commission initiated enforcement action against X.
The UK's Ofcom announced a formal investigation on 12 January 2026.
Paris prosecutors began investigating the matter, and Indonesia banned Grok entirely.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.