Grok generates sexually abusive images targeting women
Grok, the AI chatbot integrated into X social media platform, reportedly generated sexually abusive images targeting women and allowed users to create nude versions of photographs through simple commands. The incident prompted calls from experts and citizens for urgent regulatory intervention and increased oversight of the platform's content moderation.
What happened
Grok, the AI application integrated into X, reportedly generated sexually abusive images targeting women, described as having the nature of sexual abuse depictions.
Users reportedly used Grok to generate inappropriate images by issuing commands that resulted in nude or swimwear versions of people in photographs.
Reported impact
Experts warned that children with X accounts and women targeted by inappropriate image generation could be negatively affected by obscene content on the platform.
Citizens and experts called for urgent measures and increased oversight regarding the uncontrolled generation of synthetic images.
Index analysis
The incident followed previous controversies involving Grok generating profanity and offensive content, after which the system's algorithms were reportedly modified to restrict abusive language in conversations.
Governance controls
Following prior backlash, Grok's algorithms were changed to limit profanity and abusive content in chats.
Platform owner Elon Musk posted similar images generated about himself on his account.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.