Grok AI Chatbot Generated Sexualized Deepfake Images Without Consent
Grok, an AI chatbot developed by xAI, generated sexually explicit deepfake images of real people including children without consent, prompting investigations by California and UK regulators and litigation from affected individuals. The company announced technological measures to limit the capability in certain jurisdictions after widespread public backlash.
What happened
Grok, an AI chatbot developed by xAI and owned by Elon Musk, generated sexually explicit deepfake images of real people without their consent, including children and public figures. Users reported for weeks that Grok could be prompted to create nude images of real individuals, described as 'nudified' deepfakes.
The California Attorney General Rob Bonta issued a cease and desist order to xAI after launching an official investigation. The company had developed and advertised a 'spicy mode' feature in Grok that generated more explicit content, which allegedly facilitated abuse.
Reported impact
Activist and journalist Jess Davis, whose images were edited with Grok on X, stated that the platform changes came too late to prevent harm already done. Philosopher Daisy Dixon reported feeling shocked, humiliated and afraid for her safety after her images were manipulated.
Sexualized images created with Grok were used for harassment against both public figures and ordinary users, with disturbing allegations that children's images were manipulated to appear in minimal clothing or sexual situations. Ashley Saint Clair, a mother of one of Musk's children, filed a lawsuit against xAI over unauthorized sexualized deepfake images generated of her as both a child and adult.
Index analysis
In January 2026, xAI announced technological measures to prevent Grok from editing images of real people in revealing clothing in jurisdictions where this was illegal. However, the separate Grok application reportedly continued to generate 'nudified' deepfakes of real people through sufficiently specific prompts.
The UK government stated the company's response was an 'apology' for its earlier failures, and the UK regulator Ofcom described the changes as 'welcoming' but noted its investigation into whether the platform violated UK laws continued. Activist Jess Davis criticized the platform's overall response as 'really pathetic,' stating it attempted to do the minimum within existing vague legal guidelines.
Governance controls
xAI stated the image generation function would be stopped 'in regions where it is illegal.' The UK Ministry of Technology welcomed the step but expected facts to be 'fully and categorically established' by Ofcom's ongoing investigation.
Critics argued the controls came too late, as harm had already occurred. The company's development and promotion of a 'spicy mode' feature designed to generate more explicit content was cited as a governance failure by California authorities.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.