TikTok's AI-generated content flood undermines feed quality
A Kapwing report found that almost 60 percent of videos served to new TikTok users are AI-generated, with particularly high saturation in children's content categories. Experts warn that exposure to low-quality synthetic content could harm children's cognitive development and that deepfakes are spreading misinformation and propaganda.
What happened
According to a report by San Francisco video editing company Kapwing, almost 60 percent of videos served to new TikTok users on the algorithmic 'For You' page are AI-generated, three times the saturation rate on YouTube.
The 'Kids' category on TikTok showed the highest density of AI slop, with the hashtag #cartoonkids found to be 'almost entirely made of slop, with only three of the 100 videos we checked being human-made.' Once an account signals interest in AI content, the feed increases the proportion of AI-generated material served.
Reported impact
Young users browsing for educational or entertaining human-made content end up seeing AI-generated material instead. Experts warn that exposure to low-quality, 'brain-melting' AI material could endanger children's cognitive development.
Photorealistic deepfakes are facilitating the spread of misinformation and political propaganda across platforms.
Index analysis
TikTok announced in November that it would allow users to dial up or down the amount of AI-generated content on their feeds. YouTube recently announced labeling changes for AI-generated content but did not alter how videos are recommended or their eligibility to earn money.
Governance controls
Even experts find it increasingly difficult to discern between reality and AI-generated content, with deepfake technology advancing to the point where detection is challenging.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.