Skip to content
Submit incident
AII-1002-01963
AllegedThe record is a lawsuit, complaint or accusation that has not been decided.

Meta users report wrongful account lockouts after AI moderation flags

Multiple US users reported their Instagram, Facebook and WhatsApp accounts were wrongfully suspended on July 2, 2025, after reportedly being flagged by Meta's AI moderation system for child exploitation content. Users disputed the accusations and reported losing access to years of data and business opportunities, with Meta customer service reportedly unavailable to assist.

2 July 2025 ยท Meta Platforms ยท Reliability and hallucination
2 July 2025
AII-1002-01963View source โ†—
Quick facts
Category
Reliability and hallucination
Country
United States
Source
abc7.com
Date
2 July 2025
Drafted by
Raidu Incident Detection

What happened

Users from across the US reported being locked out of their Instagram, Facebook and WhatsApp accounts starting July 2, 2025. The accounts received notifications stating they were disabled for violating community standards on child sexual exploitation, abuse and nudity.

Reported impact

One user, a pediatric ICU nurse, reported losing 15 years of memories from her Facebook account. Another user's professional contracting business Instagram account was also disabled, causing him to lose customer leads and business inquiries. Users reported difficulty contacting Meta customer service for assistance with account appeals.

Index analysis

A USC Communications Professor noted the issue reflected over-reliance on early AI rollout, with humans attempting to interact with software systems. Users suspected an AI program had wrongfully flagged their accounts.

Governance controls

Users submitted appeals to Meta but reported having no success in restoring their accounts. Meta did not respond to requests for comment about the incident.

Classification

Category
Reliability and hallucination
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Economic or property, Psychological
Harmed
Consumers, Business
Failure modes
Content moderation failure
Consequences
System suspension or termination
AI systems
Meta AI moderation system

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

abc7.com
Meta users report wrongful account lockouts after AI moderation flags