Skip to content
Submit incident
AII-1002-42281
Well documentedThree or more independent publishers report the core facts.

TikTok algorithm amplifies neo-Nazi content to millions of users

Researchers from the Institute for Strategic Dialogue found that TikTok's recommendation algorithm actively amplifies neo-Nazi and white supremacist content to millions of users, particularly those interested in far-right material. Despite user reports, TikTok failed to remove hundreds of accounts openly promoting Holocaust denial, Hitler glorification, and antisemitic conspiracy theories that collectively amassed millions of views.

13 August 2024 Β· TikTok Β· Harmful and abusive content
13 August 2024
AII-1002-422814 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
Wired
Date
13 August 2024
Drafted by
Raidu Incident Detection

What happened

According to a report by the Institute for Strategic Dialogue (ISD), hundreds of neo-Nazi and white supremacist accounts openly share Hitler-related propaganda, Holocaust denial, and glorification of Nazi ideology on TikTok, with some accounts using Nazi symbols in profile pictures and white supremacist codes in usernames.

The TikTok algorithm actively promotes this content to new users, particularly those who consume far-right hate content. Extremist communities coordinate across platforms, sharing videos and audio tracks on Telegram with explicit instructions to cross-post to TikTok to increase virality, with some accounts achieving hundreds of thousands of views.

ISD researchers reported 50 accounts violating TikTok's community guidelines on hate ideologies, promoting violence, and Holocaust denial, but all remained active with TikTok designating them as having 'no violation.' The reported accounts collectively generated more than 6.2 million views.

Reported impact

Pro-Nazi content on the platform has garnered tens of millions of views, including videos promoting mass shooters, footage or reenactments of white supremacist massacres, and antisemitic conspiracy theories, reaching young audiences who form a large portion of TikTok's user base.

Index analysis

TikTok's content moderation system failed to remove hate speech and extremist accounts despite user reports and platform community guidelines prohibiting such content. The algorithm's design amplifies such content by recommending it to users with interest in far-right material, creating a self-reinforcing distribution network.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Human or fundamental rights, Psychological
Harmed
General public
Failure modes
Content moderation failure, Unsafe recommendation
AI systems
TikTok recommendation algorithm

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Wired
TikTok Has a Nazi Problem
29 July 2024
ISD
NazTok: An organized neo-Nazi TikTok network is getting millions of views
29 July 2024
Euronews English
TikTok hosts pro-Nazi network of accounts, new research finds
30 July 2024
ynetnews
Neo-Nazi content gets millions of views on TikTok. It's algorithm helps the spread, r
31 July 2024