Skip to content
Submit incident
AII-1002-48131
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

TikTok's algorithm knowingly harms children's mental health, court documents reveal

Internal TikTok documents accidentally revealed in Kentucky court filings show the company knew its algorithm harms children's mental health and was designed to be addictive, causing addiction within 35 minutes of use and correlating with losses in analytical ability, memory, and empathy. The company's screen time management tool was found to be ineffective, and documents also revealed inadequate content moderation allowing exploitation of minors.

13 October 2024 · TikTok · Safety and wellbeing
13 October 2024
AII-1002-481312 sources ↓
Quick facts
Category
Safety and wellbeing
Country
United States
Source
AfrikMag
Date
13 October 2024
Drafted by
Raidu Incident Detection

What happened

Internal TikTok documents became publicly accessible in October 2024 when sections marked as redacted in Kentucky court filings were inadvertently unredacted when copied and pasted into text files. The documents originated from a coordinated lawsuit filed by 14 U.S. states against TikTok, led by the Kentucky Attorney General.

The revealed documents show that TikTok and parent company ByteDance employees were aware of internal studies demonstrating the application causes harm to children. According to the documents, TikTok employees determined that young users can become addicted after viewing 260 videos on the platform, which at approximately 8 seconds per video equates to about 35 minutes of use.

Reported impact

According to the internal documents, intensive use of TikTok is correlated with negative mental health effects including loss of analytical abilities, memory formation, contextual thinking, depth of conversation, empathy, and increased anxiety. TikTok's screen time management tool, designed to limit daily use to 60 minutes, proved ineffective, with adolescent users averaging 107 minutes per day even with the tool enabled—a reduction of only 1.5 minutes from the 108.5-minute average before the tool's launch.

The documents also revealed that TikTok struggled with content moderation, including instances where minor girls were offered gifts and digital currency in exchange for live strip-tease performances, and substantial volumes of rule-violating content escaped moderation.

Index analysis

The Kentucky Attorney General stated that TikTok was specifically designed as an addiction machine targeting children still developing self-control, and that the company falsely claimed the platform was safe for youth. The internal documents provide evidence that company leadership and employees possessed knowledge of addiction risks and harmful mental health effects while continuing to operate and promote the platform to minors.

Classification

Category
Safety and wellbeing
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Psychological, Human or fundamental rights
Harmed
Children
Failure modes
Biased model, Data leak
Consequences
Litigation
AI systems
TikTok recommendation algorithm
Regulations
EU AI Act (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

AfrikMag
TikTok savait que son algorithme nuisait aux enfants, selon une enquête
13 October 2024
Begeek.fr
TikTok serait conscient des effets néfastes sur ses utilisateurs adolescents, selon des rapports
13 October 2024