Skip to content
Submit incident
AII-1002-50653
AllegedThe record is a lawsuit, complaint or accusation that has not been decided.

Apple urged TikTok to raise age rating; French families sue over harmful content

Apple privately urged TikTok to raise its age rating from 12+ to 17+ after finding frequent mature content, according to documents accidentally revealed in a South Carolina lawsuit. Seven French families subsequently sued TikTok, alleging its algorithm exposed their children to harmful content, marking the first collective legal challenge of its kind in Europe.

31 October 2024 Β· TikTok Β· Harmful and abusive content
31 October 2024
AII-1002-506533 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
Washington Post
Date
31 October 2024
Drafted by
Raidu Incident Detection

What happened

In 2022, Apple reviewed TikTok's age rating and determined the platform contained 'frequent or intense mature or suggestive content,' requesting TikTok increase its age recommendation from 12 and over to 17 and over according to App Store Review Guidelines. These Apple comments were accidentally made public in redacted court documents filed by South Carolina in a lawsuit against TikTok.

TikTok's own employees and outside reviewers found deficiencies in content moderation. One report indicated that only one of every 50 pop-up alerts minors in the US and UK received about profanity and eating disorders was effective. In France, seven families filed a collective lawsuit in CrΓ©teil judicial court alleging TikTok's algorithm exposed their adolescent children to harmful content including videos promoting suicide and self-harm.

Reported impact

According to documents from a Kentucky lawsuit that also had accidental public redactions, TikTok had internally found that 'compulsive usage correlates with a slew of negative mental health effects like loss of analytical skills, memory formation, contextual thinking, conversational depth, empathy, and increased anxiety.' South Carolina's complaint alleged the platform damages young users' mental health, with lawsuits filed by 14 states.

Index analysis

TikTok faced lawsuits in multiple jurisdictions over content moderation failures affecting minors. The company spent resources on lobbying efforts, including donations to parent-teacher associations and political event sponsorships, while its internal assessments and third-party reviews indicated significant content moderation gaps for young users.

Governance controls

TikTok stated it 'has always enforced strict policies against nudity, sexually explicit content, and solicitation' and claimed 'many of these issues have already been addressed.' The company also stated its commitment to safeguarding children's mental health.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Psychological
Harmed
Children, Consumers
Failure modes
Content moderation failure
Consequences
Litigation
AI systems
TikTok content recommendation algorithm

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Washington Post
Apple told TikTok it's unfit for young teens, new lawsuit details allege
31 October 2024
engadget
Apple urged TikTok to increase its age recommendations, redacted documents show
31 October 2024
Devdiscourse
French Families Sue TikTok: Social Media Giant in Legal Storm | Law-Order
4 November 2024