AI-generated deepfake faces used in large-scale fraud in China
Criminal networks in China reportedly used AI-generated deepfake faces to commit large-scale fraud and identity theft, selling fraudulent identity documents through dark web markets. Police across four provinces conducted arrests and seized equipment used to generate the deepfakes, with investigations revealing millions of yuan in losses.
What happened
Criminal networks in China used AI-generated deepfake faces to create fake identity documents and commit large-scale fraud and identity theft. The deepfake faces were sold on dark web markets at prices ranging from 5 to 10 yuan per image, with related identity documents sold for 30 to 50 yuan each.
Police across four provinces conducted arrests and seized equipment used to produce AI-generated deepfake images and videos. Over 80 percent of seized computers and 60 units of equipment were used to generate AI-generated dynamic deepfake images and videos, with investigations revealing accounts earning 6 to 8 million yuan and more than 60 million yuan in total losses.
Reported impact
The fraud scheme caused significant financial losses to victims. Authorities reported that some victims had savings depleted, with one person losing money that had been accumulated over 20 years, and the smallest victim being 18 years old.
Index analysis
Experts noted that the level of deepfake technology sophistication had increased substantially, with criminals increasingly using AI-generated synthetic media to conduct fraud. The ease of accessing such technology and the difficulty in verification posed growing risks to financial security and public safety.
Authorities emphasized that while current identity recognition methods rely on facial features, deepfake-generated images and videos present challenges to existing verification systems, potentially enabling criminals to bypass security checks.
Governance controls
Chinese authorities stated they would strengthen security protocols for identity verification systems and enhance monitoring of online platforms where synthetic media might be distributed. The government committed to increased cooperation between public security departments to combat such crimes.
Authorities indicated plans to enhance prevention measures, strengthen platform accountability, and improve oversight of communities where such information is shared.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.