xAI sues user for creating child sexual abuse deepfakes with Grok
xAI sued South Carolina resident Terry Wayne Harwood for allegedly using the Grok chatbot to create sexually explicit deepfakes and child sexual abuse material by circumventing the system's safeguards. The lawsuit comes amid separate litigation by anonymous victims and international regulatory scrutiny of Grok's ability to generate sexualized content.
What happened
xAI filed a lawsuit in Texas federal court against South Carolina resident Terry Wayne Harwood, 67, alleging he misused the Grok AI chatbot to create sexually explicit deepfakes and child sexual abuse material.
According to the complaint, Harwood opened multiple xAI accounts using false identities and designed misleading prompts to circumvent Grok's safeguards in order to convert non-sexual photographs of adults and minors into sexually explicit images without subjects' consent.
Harwood had previously been arrested in February on child sexual exploitation charges.
Reported impact
A group of five anonymous girls and women sued xAI and Stability AI in early July, alleging the companies' technology allowed sex predators to create child sexual abuse material from their non-explicit childhood photos.
The anonymous individuals reported emotional distress and fear of offline stalking by sex predators trafficking their images online, with some struggling to return to normal life.
Index analysis
The lawsuit indicates xAI is holding individual users accountable rather than addressing Grok's moderation weaknesses as the source of the problem.
Grok has faced international scrutiny, including warnings from UK government, attention from Washington regulators, EU regulatory crosshairs, and bans in Malaysia and Indonesia over sexually explicit content generated on the platform.
Governance controls
The complaint alleges that on numerous occasions, Grok refused to follow prompts that violated content moderation guardrails, but Harwood repeatedly resubmitted altered prompts to circumvent the safeguards.
xAI is seeking monetary damages and a permanent ban on Harwood's use of the platform, which has more than 2.6 million users. The lawsuit is the first brought by an AI company against one of its users.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.