AI-generated violent images traumatize Australian activist and colleagues
Caitlin Roper, an Australian activist, reportedly received AI-generated violent images and death threats showing her and colleagues from Collective Shout in graphic scenarios of harm. The personalized, realistic nature of the AI-generated content caused psychological trauma, and YouTube terminated a channel containing over 40 similar AI-generated violent videos targeting women.
What happened
Caitlin Roper, a member of the Australian activist group Collective Shout, received AI-generated death threats and violent images showing her dead in various scenarios, including hanging from a noose and ablaze. The surge of vitriol targeted Roper and her colleagues on X and other social media platforms.
Some images depicted women from the group flayed, decapitated, or fed into a wood chipper, with details like Roper's actual blue floral dress making the threats feel personalized. A YouTube channel had more than 40 realistic videos, most likely made using AI according to experts, each showing a woman being shot; YouTube terminated the channel after being contacted by The New York Times.
Reported impact
Despite years of experience in internet activism, Roper reported being traumatised by the online threats, describing the experience as 'a different kind of violation' due to the realistic and personalized nature of the AI-generated imagery.
The psychological impact was intensified by the visceral realism and convincingness of the AI-generated content, which made the threats more personalized, more convincing and more easily delivered than traditional hostile communications.
Index analysis
Generative AI technology is being used to create digitally generated violent threats that are rapidly becoming easier to make and more persuasive than previous forms of online abuse. The technology enables harassers to maximize fear through personalized, convincing depictions of victims in life-threatening scenarios.
Governance controls
YouTube said it had terminated the channel containing the violent videos for 'multiple violations' of its guidelines after The New York Times contacted the platform.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.