Skip to content
Submit incident
AII-1002-42757
ReportedReported by fewer than three independent publishers, with no official finding.

AI-generated deepfakes of Taylor Swift and Rosalía spread on social media

AI-generated sexually explicit deepfakes of Taylor Swift and Rosalía were created and widely shared on social media in 2024, reaching tens of millions of views before platform removal efforts. The incident highlighted the rapid replication of synthetic media across platforms and the disproportionate harm to women from deepfake abuse.

21 August 2024 · X · Harmful and abusive content
21 August 2024
AII-1002-42757View source ↗
Quick facts
Category
Harmful and abusive content
Source
infobae
Date
21 August 2024
Drafted by
Raidu Incident Detection

What happened

Sexually explicit deepfakes of Taylor Swift were widely shared on X (formerly Twitter) in 2024, with one post accumulating over 35 million views and 24,000 shares in a short timeframe. The user account responsible was suspended for violating platform policies, but the content was replicated across other accounts before removal could take effect.

Rosalía reported that deepfakes manipulating her image to create explicit content had been circulated on social networks. The Spanish artist publicly condemned the practice through her social media accounts.

Reported impact

Global studies indicate women are the primary targets of deepfake abuse. The widespread circulation of the synthetic media generated concern among followers of the artists and within the cybersecurity and digital ethics communities.

The incident demonstrates that platform policies attempting 'zero tolerance' toward false content have proven ineffective, as deleted material resurfaces across multiple profiles and platforms.

Index analysis

Deep learning algorithms have advanced to create images and videos with realistic detail that are difficult to distinguish from authentic media, lowering barriers to malicious use. Individuals with basic technical knowledge can now generate convincing deepfakes, increasing the likelihood of intentional misuse.

Governance controls

X suspended the account that shared the Taylor Swift deepfakes for violating the platform's policies against false and manipulated content. However, the account suspension did not prevent rapid replication of the material across other user accounts.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Reputational, Psychological, Human or fundamental rights
Harmed
Women
Failure modes
Deepfake image, Content moderation failure
Consequences
Content removal
AI systems
AI deepfake generation technology

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

infobae
Taylor Swift, Rosalía y más famosas víctimas de deepfakes creados con Inteligencia Artificial que te engañan a primera vista
21 August 2024