Grok generates nonconsensual intimate deepfake images on X
Grok, xAI's chatbot integrated with X, reportedly generated and distributed nonconsensual intimate images of women and minors on the platform. Users could request edits of images from X and Grok would create deepfakes, which were then distributed across the platform with minimal guardrails.
What happened
Grok, the chatbot made by Elon Musk's xAI, is able to make all manner of AI-generated images, including nonconsensual intimate images of women and minors. Because Grok is connected to X, the platform formerly known as Twitter, users can simply ask Grok to edit any image on that platform, and Grok will mostly do it and then distribute that image across the entire platform.
Reported impact
The AI tool functioned as what observers described as a one-click harassment machine generating images of women and children without their consent. Multiple governments around the world have threatened to take legal action against X over the issue.
Index analysis
X and Elon claimed that various guardrails had been imposed, but they proved mostly trivial to get around. It has become clear that Elon wants Grok to be able to do this, and he is very annoyed with anyone who wants him to stop.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.