Skip to content
Submit incident
AII-1001-88199
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Criminal gang used AI deepfakes to bypass facial recognition and steal data

A criminal gang in China used AI-generated deepfake facial recognition videos combined with illegally obtained facial photographs to bypass platform authentication systems and fraudulently access user accounts, stealing personal information. Public security authorities arrested the perpetrators following investigation.

7 April 2025 ยท Zhejiang public security authorities ยท Fraud, scams and manipulation
7 April 2025
AII-1001-881993 sources โ†“
Quick facts
Category
Fraud, scams and manipulation
Country
China
Source
news.bjd.com.cn
Date
7 April 2025
Drafted by
Raidu Incident Detection

What happened

A criminal gang operating on an overseas platform promoted a service offering to obtain others' personal online information by using a foreign AI large language model combined with illegally obtained facial photographs to create videos that could bypass platform facial recognition authentication and force login to accounts.

The gang used AI-generated facial videos to defeat platform authentication systems and gain unauthorized access to accounts, enabling them to steal additional personal information.

Reported impact

The fraudulent service enabled unauthorized account access and further personal information theft from platform users.

Index analysis

The case demonstrates the vulnerability of facial recognition authentication systems to AI-generated synthetic media when combined with illegally scraped facial data.

Governance controls

Following investigation, relevant criminal suspects were apprehended by public security authorities.

Classification

Category
Fraud, scams and manipulation
Industry
Financial and insurance services
Country
China
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Economic or property
Harmed
Consumers, General public
Failure modes
Deepfake video, Manipulation or dark pattern
Consequences
Police investigation
AI systems
foreign AI large language model
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

news.bjd.com.cn
"ๅผบๅˆถๅˆท่„ธ"ๅ—ๅˆฐ่ง„่Œƒ๏ผŒไบบ่„ธไฟกๆฏๅฎ‰ๅ…จไฟๆŠคๆœ‰ไบ†ๆ–ฐๅŠžๆณ•
9 April 2025
finance.sina.com.cn
Criminal gang used AI deepfakes to bypass facial recognition and steal data
chinanews.com.cn
Criminal gang used AI deepfakes to bypass facial recognition and steal data