Skip to content
Submit incident
AII-1000-96387
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

UK Government Considers Leaving X After Grok Generates Child Sexual Images

X's AI tool Grok was reportedly used to generate criminal imagery depicting children, confirmed by the Internet Watch Foundation. The UK Government faced calls to abandon the platform following the disclosures, though ministers initially resisted a full boycott despite demanding X improve its safeguards.

8 January 2026 Β· X Β· Harmful and abusive content
8 January 2026
AII-1000-963875 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United Kingdom
Source
The Independent
Date
8 January 2026
Drafted by
Raidu Incident Detection

What happened

X's AI tool Grok was used to generate sexualised images of children aged between 11 and 13. The Internet Watch Foundation confirmed the existence of this 'criminal imagery' and reported that users were sharing the material in a dark web forum while 'boasting how they had used Grok, and how easy it had been'.

Reported impact

Former Labour cabinet minister Louise Haigh called the situation 'unconscionable' and urged the Labour Party and UK Government to 'remove themselves entirely from X' due to concerns about child sexual abuse material being created and shared on the platform.

Index analysis

The failure of Grok's safety mechanisms allowed the tool to generate criminal imagery depicting children. The shared reports of users boasting about the ease of creating such material suggest the tool lacked adequate safeguards or content filtering.

Governance controls

UK Prime Minister Keir Starmer demanded that X 'urgently get their act together' and threatened to take action against the platform. However, government sources rejected calls for a boycott, stating 'It is up to Elon Musk to make sure this is a platform where everyone can feel welcome.'

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United Kingdom
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Human or fundamental rights
Harmed
Children
Failure modes
Content moderation failure
AI systems
Grok

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

The Independent
Former Labour minister tells Starmer's government to quit X
8 January 2026
the Guardian
UK ministers considering leaving X amid concern over AI tool images
9 January 2026
City AM
Government urged to quit X following 'appalling' Grok scandal
8 January 2026
Morning Star
Ministers considering leaving X over Grok child sexual images scandal
9 January 2026
The Star
MP calls on government to stop using X amidst AI child abuse scandal
10 January 2026