California AG Orders xAI to Halt Grok's Creation of Sexualized Deepfakes
California's Attorney General issued a cease and desist letter to xAI, ordering the company to stop using its Grok AI chatbot to create and distribute non-consensual sexualized imagery, including deepfakes and child sexual abuse material.
What happened
California Attorney General Robert Bonta issued a cease and desist letter to xAI on Friday, demanding the company halt the creation and distribution of AI-generated non-consensual sexualized imagery by its Grok AI chatbot.
The letter specifically targets Grok's involvement in producing deepfake nonconsensual intimate images and child sexual abuse material.
Reported impact
The enforcement action reflects growing concerns over AI technology's misuse to produce intimate images without consent and disseminate child sexual abuse material.
Index analysis
The cease and desist letter underscores efforts to regulate the misuse of AI technologies, aligning with broader legislative initiatives to protect individual privacy and integrity from advanced technological exploitation.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.