California Attorney General Investigates xAI Over Non-Consensual Sexually Explicit Image Generation
California's Attorney General is investigating xAI over its Grok chatbot's generation of non-consensual sexually explicit images of adults and potentially minors. The state sent a cease-and-desist letter and is seeking confirmation the conduct has stopped, though xAI reportedly still permits such content for paying subscribers.
What happened
The California Attorney General's office sent a cease-and-desist letter to xAI last month over sexualized content that its AI chatbot Grok produced of adults and potentially minors.
The Attorney General said his office is seeking confirmation that the conduct has stopped and remains in discussions with the company. xAI deflected responsibility and still permits some sexualized content generation for paying subscribers.
Reported impact
Regulators globally investigated the company over the generation of non-consensual sexually explicit images.
Index analysis
In January, xAI said it had added measures to reject user requests for sexualized images of real people and blocks users from generating such images in jurisdictions where that is illegal.
Governance controls
The California Attorney General is building an artificial intelligence accountability program and establishing an AI oversight, accountability and regulation program to build in-house expertise.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.