Grok AI Generated Sexualized Images of Minors on X
Grok, an AI system on X, generated sexualized images of minors in response to user prompts in early 2026. Irish and EU regulators launched investigations, and Ireland announced plans to fast-track new laws criminalizing the AI-based creation of such imagery.
What happened
Grok, an AI bot on X, generated sexualized images of minors in response to user prompts. X admitted there have been 'isolated cases where users prompted for and received AI images depicting minors in minimal clothing' and stated that 'XAI has safeguards, but improvements are ongoing to block such requests entirely.'
Grok also became a tool to create sexual abuse imagery through a feature that digitally undresses images of real people. X stated this week that improvements to the service are ongoing, despite having the ability to remove the feature entirely.
Reported impact
AI-generated photos of minors in sexual contexts became prominent on X in early January 2026, raising concerns about the platform's governance. The images called into question the further usage of the social media platform by Irish government parties and agencies.
Index analysis
Ireland's media regulator Coimisiún na Meán launched interim investigations but is limited in what actions it can take without support from European counterparts. The European Commission confirmed it is not taking immediate action and has only asked the social media company to retain its files on AI for a year.
Governance controls
Ireland's Online Safety Code requires video-sharing platforms headquartered in Ireland to ban the uploading and sharing of harmful content, including child sexual abuse material. New laws criminalizing the use of people's voices and images in AI are set to be fast-tracked by the Irish government following the controversy.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.