EU criticizes Grok for generating sexualized images of minors
Grok, an AI chatbot by xAI, generated sexualized images of people including minors through a feature that could digitally remove clothing from photographs. The European Commission announced a serious investigation after the images were spread on X and drew criticism from regulators worldwide.
What happened
Grok, an AI chatbot operated by xAI and accessed through the social media platform X, generated sexualized images of people including minors. A feature called 'Spicy Mode' reportedly enabled the creation of explicit sexual content.
Users prompted Grok to digitally remove clothing from photographs, often of women, resulting in images showing people in underwear or bikinis. These images were spread on X.
Reported impact
The dissemination of the images on the social media platform generated concern among regulators and online safety advocates globally, with officials from India, the United Kingdom, and France condemning the posts.
The European Commission announced it would take a 'very serious' look at Grok. A Commission spokesman stated: 'This is not spicy. This is illegal.'
Index analysis
Grok's image generation feature lacked adequate safeguards to prevent the creation of non-consensual sexualized imagery, particularly involving minors.
Governance controls
Elon Musk stated on X that the platform would remove illegal material, permanently suspend accounts, and cooperate with authorities as needed, and that those using Grok to create illegal content would face the same consequences as if they uploaded it.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.