Skip to content
Submit incident
AII-1001-94917
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Douyin Cracks Down on AI-Generated Content Misuse

Douyin (TikTok China) launched a special crackdown on "AI account creation" activities, removing 311 pieces of violative content and banning 15 severely non-compliant accounts. The action targeted misuse of AI to generate obscene or sensationalized videos, fake expert personas, account-selling tutorials, and platform manipulation schemes.

19 May 2025 · Douyin · Misinformation and synthetic media
19 May 2025
AII-1001-949172 sources ↓
Quick facts
Organization
Douyin (deployer)
Category
Misinformation and synthetic media
Country
China
Source
凤凰网(凤凰新媒体)
Date
19 May 2025
Drafted by
Raidu Incident Detection

What happened

On May 19, 2025, Douyin announced a special governance action targeting 'AI account creation,' a phenomenon where users misuse AI tools to generate content and accounts.

The targeted behaviors included using AI to generate obscene or sensationalized videos, AI-generated virtual foreign early childhood education experts teaching parenting content, selling AI video account tutorials, sharing AI account secrets, guiding users to evade platform AI labeling, and transferring or selling AI virtual accounts.

Douyin cumulatively removed 311 pieces of violative content and banned 15 severely non-compliant accounts including those labeled as '心x甜,' '向xAi同城流量,' and '瑞xxAI智习室.'

Reported impact

The platform stated that some users were using AI for deception, leveraging AI account creation, and trafficking in AI accounts, causing severe damage to the platform's ecosystem.

The action was part of broader governance efforts announced in 2023 and 2024 to regulate AI-generated content and discourage low-quality creation using AI-generated virtual persons.

Index analysis

The misuse of AI systems to generate fake expert personas and obscene content exploited the capacity of generative AI to produce convincing synthetic media at scale.

Account trafficking schemes relied on the ease of deploying trained AI systems to rapidly establish multiple accounts with minimal manual effort, allowing users to circumvent detection and platform restrictions.

Governance controls

Douyin had previously published platform normative guidance in 2023 and 2024 stating that it did not encourage use of AI-generated virtual persons for low-quality creation and would strictly penalize violations involving misinformation or deception.

The platform encouraged users and creators to label AI-generated content and invited users to report violations via in-platform reporting or email to feedback@douyin.com, stating it would verify and handle reports promptly.

Classification

Organization
Douyin (deployer)
Category
Misinformation and synthetic media
Industry
Media, social platforms and marketing
Country
China
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Public interest
Harmed
General public, Consumers
Consequences
Content removal, System suspension or termination
AI systems
Douyin AI content generation systems

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

凤凰网(凤凰新媒体)
抖音开展"AI起号"专项治理行动,重点整治利用AI生成低俗猎奇视频等行为
19 May 2025
xkb.com.cn
抖音开展"AI起号"专项治理,整治利用AI生成低俗猎奇视频等@抖音黑板报2025-5-19
19 May 2025
May 2026China suspends 98,000 social media accounts for unlabeled AI-generated contentConfirmedMisinformation and synthetic mediaapp.myzaker.comChina News东方财富网+5Mar 2026AI-generated content manipulation and misinformation spark regulatory action in ChinaConfirmedMisinformation and synthetic mediachinaz.comChina NewsMar 2026Chinese Accounts Use AI to Generate Low-Quality Content and Manipulate Platform AlgorithmsConfirmedMisinformation and synthetic mediaThe Epoch Timeschina.org.cn/china.com.cn(中国网)法制日报+4May 2025AI-Generated Misinformation Accounts Shut Down After Public PanicConfirmedMisinformation and synthetic media新华网news.china.com.cnJun 2026Bytedance AI assistant misidentifies toxic mushroom, user poisoned in ChinaWell documentedSafety and wellbeingETtoday AI科技北青网ai.zol.com.cn+3