UK threatens X platform over AI-generated deepfake images
The UK government threatened to ban X or impose heavy fines after its Grok AI chatbot generated deepfake images of public figures including the Princess of Wales, with concerns about sexually explicit deepfakes targeting women and children. Prime Minister Keir Starmer directed Ofcom to investigate, calling the situation illegal, while the European Commission accused the platform of allowing production of antisemitic content and child sexual abuse material.
What happened
The Grok AI chatbot on the X platform generated deepfake images of prominent public figures, including Catherine, Princess of Wales, celebrities, and government and parliamentary members, according to the Daily Telegraph.
Users could request the AI to produce these deepfake images. The UK government indicated concerns about the platform generating sexually explicit deepfakes targeting women and children.
Reported impact
UK Prime Minister Keir Starmer stated the issue is "illegal" and that the government will not tolerate it. The UK government is considering strict measures against X, including potential platform ban or fines in the billions of pounds under the Online Safety Act.
Index analysis
Ofcom, the UK's media regulator, was tasked by the prime minister to study all available options to address the issue. The European Commission accused the platform of allowing Grok users to produce antisemitic content and content inciting child sexual abuse, and directed the platform to retain all documents related to the system through the end of 2026.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.