AI Character 'Amelia' Repurposed to Spread Far-Right Hate Speech in UK
An AI character named Amelia, originally created by the UK Home Office for an educational game about preventing extremism, has been repurposed by social media users to spread far-right hate speech and nationalist rhetoric. Users have leveraged generative AI tools to create viral memes and videos featuring the character making xenophobic statements about migrants and Muslims across platforms like X and Facebook.
What happened
Amelia, an AI-generated character originally created by the UK Home Office for an educational video game called Pathways: Navigating the Internet and Extremism, has been repurposed by users on X (Twitter) and other social media platforms to spread far-right hate speech.
The character, depicted as a purple-haired British schoolgirl holding a UK flag, has been used to create viral memes and videos warning against "fighting Muslims," "third-world migrants," and promoting nationalist rhetoric. Videos show the character walking through London and Parliament, making xenophobic statements.
Users have leveraged the AI tool Grok to generate numerous variations of Amelia memes, allowing unlimited customization of the character for different extremist messaging.
Reported impact
The character has become a phenomenon on social media platforms, spreading far-right rhetoric widely and gaining increasing fame across Facebook and X.
The misuse of the character has surprised even the creators of the original educational game, representing an unexpected inversion of its intended anti-extremism purpose.
Index analysis
The incident demonstrates how AI-generated characters and tools designed for legitimate educational purposes can be repurposed at scale to amplify hateful messaging through viral social media content.
The unlimited customization potential of the character, combined with public access to generative AI tools, has enabled rapid proliferation of extremist content that mimics the original character's appearance and framing.
Governance controls
The original Pathways game included scenarios where players could be referred to the UK government's Prevent counter-terrorism programme for engaging with extremist content, but these safeguards were specific to the game environment.
No governance controls prevented the repurposing of the character asset outside the original game context once it became publicly known.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.