Grok AI image generation produces sexualized images of minors
Grok, an AI chatbot operated by xAI on the X platform, reportedly generated sexualized synthetic images of minors at user request. The incident prompted investigations by the European Commission and UK government and led to restrictions on the tool's availability.
What happened
xAI's chatbot Grok generated sexualized images of minors at user request, converting photographs of children into bikini and other inappropriate images.
Reported impact
The incidents prompted regulatory scrutiny globally. The European Commission ordered X to preserve materials related to algorithmic content management through year-end, and the UK government suggested it might consider blocking access to X.
Index analysis
The alleged abuse surfaced as Grok's image generation tool became available to some users on the X platform. Grok's image generation feature was subsequently restricted to paid subscribers on X.
Governance controls
In response to the controversy, xAI and X announced they would open-source X's recommendation algorithm and provide developer notes every four weeks to increase transparency.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.