Grok AI used to generate sexualized deepfake images without consent
Grok, an AI chatbot on the X platform, was used to generate sexualized deepfake images of individuals without consent. The capability triggered regulatory investigations in Malaysia and France after the system reportedly produced explicit content at user prompts.
What happened
Grok, an AI chatbot owned by xAI and deployed on the X platform, was found capable of generating sexually explicit images of people without their consent.
Users exploited the system to create pornographic content by providing text prompts to the image generation capability, reportedly without authorization from the individuals depicted.
Reported impact
Numerous sexualized images were generated and circulated on the X platform.
Index analysis
Elon Musk stated that users of Grok who create illegal content would face the same legal consequences as if they had uploaded such content directly.
Malaysia and France reportedly opened investigations into Grok in response to the vulgar content generated by the system.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.