Skip to content
Submit incident
AII-1002-67457
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

Meta content policy rollback poses genocide risk, experts warn

Human rights experts and genocide survivors have warned that Meta's January 2025 policy changes—including lifting bans on denigration of minorities and significantly rolling back automated content moderation—risk enabling mass violence and genocide, similar to Meta's documented role in the 2017 Myanmar atrocities against Rohingya Muslims.

7 January 2025 · Meta · Harmful and abusive content
7 January 2025
AII-1002-674572 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
Amnesty International
Date
7 January 2025
Drafted by
Raidu Incident Detection

What happened

On January 7, 2025, Meta CEO Mark Zuckerberg announced significant changes to Meta's content policies. The changes included lifting prohibitions on previously banned speech such as denigration and harassment of racialized minorities, immigrants, women, and transgender individuals, and replacing fact-checkers with a community notes system.

Meta also announced a drastic shift in content moderation practices, with automated content moderation being significantly rolled back and content moderators relocated from California to Texas. Zuckerberg framed the changes as an anti-censorship campaign aimed at prioritizing free expression.

A whistleblower complaint was filed with the Securities and Exchange Commission regarding Meta's historical contribution to mass violence against the Rohingya people in Myanmar.

Reported impact

Human rights experts and genocide survivors warned that the policy changes pose a grave threat to vulnerable communities globally and drastically increase the risk that Meta will again contribute to mass violence and genocide.

A former Meta employee stated: 'I really think this is a precursor for genocide [...] We've seen it happen. Real people's lives are actually going to be endangered.'

Index analysis

Meta's algorithms have been documented to prioritize and amplify harmful content including advocacy of hatred, misinformation, and content inciting racial violence. Research has shown these algorithms consistently elevate content that generates strong emotional reactions.

Amnesty International noted that in 2017, Myanmar security forces undertook a brutal campaign of ethnic cleansing against Rohingya Muslims, and that Facebook had become an echo chamber of virulent anti-Rohingya hate speech in the years preceding the attacks.

Governance controls

Amnesty International has called on Meta shareholders to hold the company's leadership accountable to prevent Meta from becoming a conduit for mass violence or genocide.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Potential harm
Intent
Unknown
Timing
Unknown
Harm types
Human or fundamental rights, Physical death, Public interest
Harmed
General public, Civil society
Failure modes
Content moderation failure
Consequences
Regulatory investigation
AI systems
Meta content moderation systems
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Amnesty International
Meta's new content policies risk fueling more mass violence and genocide
17 February 2025
Common Dreams
Human Rights Experts: Meta's Trump-Friendly Policies Could Be 'Conduit' for 'Genocide' | Common Dreams
17 February 2025