xAI sues Grok user for generating child sexual abuse material and deepfake content
xAI filed a civil lawsuit against a South Carolina user alleging he used Grok to generate child sexual abuse material and non-consensual sexual deepfakes. The defendant was previously arrested on suspicion of child sexual exploitation in February 2026. xAI reported suspending over 52,000 accounts for policy violations and submitting over 73,000 reports to child protection authorities.
What happened
xAI filed a civil lawsuit on July 14, 2026 against Terry Harwood, a South Carolina man, alleging he used Grok to generate child sexual abuse material (CSAM) and non-consensual deepfake sexual images.
Harwood had uploaded photos of adults and minors and requested Grok generate pornographic deepfake images of the people in the photos. He was arrested in February 2026 on suspicion of child sexual exploitation.
Reported impact
As of 2026, xAI suspended 52,222 accounts for policy violations and submitted 73,604 reports to the National Center for Missing & Exploited Children (NCMEC), which assisted law enforcement in at least 244 arrests.
Index analysis
xAI stated the defendant "deliberately planned to turn the plaintiff's tool into a weapon for crime." xAI seeks damages and a permanent ban on the defendant's use of Grok.
Governance controls
xAI and other AI companies including OpenAI, Google and Anthropic have updated content safety mechanisms to restrict generation of child sexual abuse material, non-consensual sexual content and other illegal material. This lawsuit represents an AI platform's use of legal action alongside technical safeguards to hold users accountable for misuse.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.