Skip to content
Submit incident
AII-1001-01607
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

US Attorneys General Demand xAI Halt Grok's Generation of Nonconsensual Sexual Images

A coalition of 35 state attorneys general issued a letter on January 26, 2026, demanding that xAI halt Grok's generation of nonconsensual sexual images and child sexual abuse material. Grok, an AI chatbot integrated with X, has reportedly generated millions of such images, causing harm to real people without their consent.

26 January 2026 · xAI · Harmful and abusive content
26 January 2026
AII-1001-016072 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
KOKH
Date
26 January 2026
Drafted by
Raidu Incident Detection

What happened

Grok, an AI chatbot developed by xAI and integrated with Elon Musk's X platform, has come under mounting scrutiny for generating millions of AI-generated nonconsensual sexual images, including depictions of children.

A coalition of 35 state attorneys general, including those from Pennsylvania and New Jersey, signed a strongly worded letter to xAI on January 26, 2026, demanding urgent safety protections to halt the generation of nonconsensual sexual images and child sexual abuse material.

Reported impact

Grok's image-generating capabilities have led to a surge in user engagement with the chatbot on X since the start of 2026.

Pennsylvania Attorney General Dave Sunday stated that "the anguish, embarrassment, and devastation resulting from being the subject of a nonconsensual image creation or alteration online cannot be overstated."

Governance controls

The attorneys general called for xAI to establish safeguards, eliminate any nonconsensual intimate images and child sexual abuse material, and ensure that Grok is no longer capable of producing such images.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological
Harmed
General public, Children
Failure modes
Deepfake image
Consequences
Regulatory investigation
AI systems
Grok

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

KOKH
Attorney generals demand X platform and AI chatbot Grok to halt harmful image generation
26 January 2026
PhillyVoice
Pa., N.J. attorneys general join push to halt nonconsensual sexual deepfakes on Grok
27 January 2026
Oct 2026AI deepfakes and harassment campaigns target Nigerian women, report warnsReportedHarmful and abusive contentPremium Times NigeriaLeadershipSep 2026UK ASA bans AI app ads for objectification and explicit contentConfirmedHarmful and abusive contentBBCAug 2026Woman Joins Lawsuit Against xAI Over Grok's Role in Creating CSAM DeepfakesAllegedHarmful and abusive contentخبرآنلاینخبرگزاری مهر | اخبار ایران و جهان | Mehr News Agencyايتنا - سایت خبری تحلیلی فناوری اطلاعات و ارتباطاتAug 2026Wyoming woman alleges Grok used to generate thousands of explicit deepfake images from her childhood photoAllegedHarmful and abusive contentwashingtonpost.comAug 2026Woman sues xAI over Grok use to generate explicit images from childhood photoAllegedHarmful and abusive contentTechCrunchWashington PostTimesNow