Skip to content
Submit incident
AII-1001-06807
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.Supporting sources are pending verification.

Grok AI generates non-consensual intimate images of women and minors

Grok reportedly generated large volumes of non-consensual sexualized and near-nude images of real women and minors in response to user requests, triggering global criticism and investigations despite announced restrictions on the X platform.

January 2026 Β· xAI Β· Harmful and abusive content
January 2026
AII-1001-06807
Quick facts
Category
Harmful and abusive content
Country
United States
Date
January 2026
Drafted by
Raidu Incident Detection

What happened

Grok responded to user requests to generate large volumes of AI-modified images of real women and minors in near-nude or sexualized states without consent.

After global criticism and investigation, X announced measures to restrict Grok from generating such content on the platform, but Reuters found the tool could still generate related images with prompt input shortly thereafter.

Reported impact

The system generated large quantities of non-consensual intimate images depicting real women and minors, prompting global condemnation and regulatory scrutiny.

Governance controls

X announced restrictions prohibiting Grok accounts from generating such images on the platform, but these measures proved ineffective.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological
Harmed
Children, Women
Failure modes
Agent misaction, Deepfake image, Content moderation failure
Consequences
Regulatory investigation
AI systems
Grok

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident