Irish Government Expresses Concerns Over Grok AI's Generation of Harmful Images on X
Non-consensual intimate images and child sexual abuse material were reportedly generated by Grok AI on X, prompting Ireland's Minister for AI to meet with X executives and express concerns about insufficient safeguards. X disabled the nudification feature on its platform but concerns remain about the standalone Grok app.
What happened
Non-consensual sexualised and nude images generated by Grok AI flooded the X platform in recent weeks. xAI released a statement saying it would geoblock the 'nudification' ability in Grok accounts and in Grok in X in those jurisdictions where it is illegal.
Reported impact
Minister Niamh Smyth, Minister of State with responsibility for AI, expressed serious dismay at what had been facilitated on the platform, emphasising that the sophistication of safeguards must match the sophistication of the technology. She stated that such activity will not be tolerated and concerns remain regarding Grok as a standalone app, which is something the Government will examine further.
Index analysis
Minister Smyth met with the Attorney General to seek clarity on what constitutes illegal content under Irish and EU law. She pointed to the Child Trafficking and Pornography Act 1998, which criminalises material depicting a person as a child engaged in explicit activity, and Coco's Law, which criminalises sharing non-consensual intimate images with intent to cause harm.
Governance controls
X informed Minister Smyth that corrective actions have been implemented and that Grok, as integrated on the X platform, has been disabled from removing or reducing clothing on individuals worldwide. Minister Smyth welcomed these actions but sought assurance that this capability will not be reintroduced, and scheduled a follow-up meeting with X to ensure adequate and enduring protections remain in place.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.