Skip to content
Submit incident
AII-1002-69203
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

TikTok AI blocks 18 Malaysian media accounts reporting mosque assault

TikTok's automated content moderation system permanently blocked the accounts of 18 Malaysian media organizations reporting on a mosque sexual assault case, unable to distinguish journalistic coverage from prohibited content. Malaysia's Communications Ministry confirmed the AI misjudgment and initiated discussions with TikTok to prevent similar incidents and potentially grant media outlets exemptions from automated moderation.

21 February 2025 · TikTok · Reliability and hallucination
21 February 2025
AII-1002-692036 sources ↓
Quick facts
Category
Reliability and hallucination
Country
Malaysia
Source
MARKETING Magazine
Date
21 February 2025
Drafted by
Raidu Incident Detection

What happened

TikTok permanently blocked the accounts of 18 Malaysian media organizations reporting on a sexual assault incident at a mosque in Petaling Jaya. The blockedmedia outlets had covered the assault case, in which video footage was recorded by CCTV.

Communications Minister Fahmi stated that TikTok's AI system automatically flagged and blocked the accounts because it could not distinguish between journalistic reporting and regular user-generated content. One outlet, 《当今大马》, had its account briefly suspended but was restored after intervention.

Reported impact

The media organizations reported they had not violated any media ethics codes, noting that the videos did not clearly display the victim's image. Multiple local media outlets were unable to operate their TikTok accounts, affecting their ability to distribute news content on the platform.

Index analysis

The minister acknowledged that TikTok's AI system occasionally makes serious misjudgments and cannot differentiate between news reporting by media institutions and content posted by regular users. TikTok recently strengthened its content moderation AI capabilities, but the system is still producing false positives on legitimate journalistic content.

Governance controls

The Malaysian government requested a meeting with TikTok to clarify how media outlets' accounts operate on the platform and to prevent future incidents. The Communications Ministry proposed granting media institutions exemptions or different status on TikTok, citing their own editorial guidelines and ethical standards that should be recognized separately from general user content policies.

Classification

Category
Reliability and hallucination
Industry
Media, social platforms and marketing
Country
Malaysia
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Public interest
Harmed
Business, Civil society
Failure modes
Content moderation failure, Misidentification
AI systems
TikTok content moderation AI

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

MARKETING Magazine
TikTok's AI Blocks Accounts of 18 Malaysian News Outlets!
24 February 2025
BERNAMA
要TIKTOK交代18媒体账号被锁·法米:AI误判清真寺猥亵报道
24 February 2025
CNA
Malaysian government in talks with TikTok to restore 18 media outlets' accounts blocked by AI: Minister
24 February 2025
Malay Mail
MCMC seeks clarification from TikTok over blocking of 18 local media outlets, says Fahmi
24 February 2025
Malaysiakini
就非礼案报道锁18媒体账号,法米要TikTok交代
24 February 2025
The Star
Fahmi: Govt in talks with TikTok to reinstate 18 media accounts banned by AI
24 February 2025
Apr 2026TikTok scales back AI video summaries after generating bizarre errorsConfirmedReliability and hallucinationBBCBusiness InsiderOct 2026AI-Generated Deepfake Videos Spread Disinformation About Ukrainian Military SurrenderConfirmedMisinformation and synthetic mediaУкраинская сеть новостейunn.uaУКРІНФОРМ+5Oct 2026AI-generated deepfake videos spread on TikTok in Russian disinformation campaign targeting UkraineConfirmedMisinformation and synthetic mediaУКРІНФОРМВисокий ЗамокSep 2026Japanese voice actor sues TikTok over AI voice cloningAllegedIntellectual property and appropriationThe Straits Timesnews.hsw.cnSep 2026AI-powered influence campaigns manipulate social media in US and IsraelConfirmedMisinformation and synthetic mediaAnadolu AjansıThe Jerusalem Post