Grok AI image generator produces unfiltered fake political images
Grok 2, an image generation system made available to X Premium users, reportedly produced unfiltered fake images of U.S. political figures including a viral fake image of Kamala Harris and Donald Trump together, raising concerns about potential election disinformation.
What happened
Grok 2, an image generation AI based on FLUX.1, was made available to X Premium subscribers. Despite stated guidelines prohibiting generation of violent, obscene, defamatory and deepfake images, users reported the system had minimal content moderation.
Users rapidly generated fake images using the system, including a viral image of Donald Trump and Kamala Harris kissing, Barack Obama sniffing cocaine, and Trump wielding weapons. The Verge reportedly created a fake image of Barack Obama attempting to stab Joe Biden.
Reported impact
The unfiltered image generation capability raised concerns about potential disinformation during the 2024 U.S. presidential election, with observers noting that realistic fake images could deceive voters.
Index analysis
Grok's content moderation guidelines stated limitations on illegal activities and deepfakes or misleading media, but users reported these restrictions were not enforced in practice, allowing generation of politically sensitive and offensive content.
Governance controls
The system was made available only to X Premium subscribers, limiting distribution compared to freely available alternatives, though this did not prevent wide sharing of generated images on the platform itself.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.