Skip to content
Submit incident
AII-1002-42143
ReportedReported by fewer than three independent publishers, with no official finding.

Chinese AI video generators enable deepfake creation with minimal safeguards

Chinese tech companies have released AI video generators that allow users to create synthetic videos from text prompts with minimal safeguards. Testing revealed the tools can manipulate images of individuals without consent, raising concerns about deepfakes and privacy risks especially for young people.

14 August 2024 Β· ByteDance Β· Harmful and abusive content
14 August 2024
AII-1002-421432 sources ↓
Quick facts
Category
Harmful and abusive content
Country
China
Source
Bloomberg Business
Date
14 August 2024
Drafted by
Raidu Incident Detection

What happened

Chinese tech companies including ByteDance and Kuaishou Technology released AI video generators that convert text prompts into short videos. The tools allow users to create clips from almost any prompt they can imagine with minimal restrictions.

Reported impact

A Bloomberg Opinion journalist tested the tools and found one generated a video from her headshot that removed her jacket and shirt. The easily accessible technology raises concerns about synthetic media creation and privacy risks, particularly for young people.

Index analysis

The AI video generators lack adequate safeguards to prevent misuse. The tools did not respond to requests for videos of political figures, but demonstrated capability to manipulate images of individuals without consent.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
China
Harm status
Potential harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Reputational, Psychological, Human or fundamental rights
Harmed
General public, Women, Children
Failure modes
Deepfake video, Content moderation failure, Deepfake image
AI systems
Chinese AI video generators

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Bloomberg Business
China's AI Video Rush Is a Wake-Up Call for the World
14 August 2024
CNA
Commentary: China's AI video rush is a wake-up call for the world
15 August 2024