Skip to content
Submit incident
AII-1001-83327
Well documentedThree or more independent publishers report the core facts.Supporting sources are pending verification.

AI deepfake scams exploit elderly in livestreams; platforms deploy countermeasures

Scammers are reportedly using AI deepfake technology in livestream rooms to defraud elderly people in China, alongside other fraud schemes. Guangxi authorities are developing AI-based anti-fraud tools, including a specialized large model, to detect and prevent cross-border telephone fraud.

8 March 2025 Β· Guangxi Zhuang Autonomous Region Β· Fraud, scams and manipulation
8 March 2025
AII-1001-83327
Quick facts
Category
Fraud, scams and manipulation
Country
China
Date
8 March 2025
Drafted by
Raidu Incident Detection

What happened

Network scams using AI face-swapping and deepfakes have become widespread in livestream rooms, targeting elderly people alongside other fraudulent schemes including fake medicines, investment schemes, and secret courses promising easy wealth.

A representative of Guangxi state that the region is developing an AI vertical anti-fraud large model to combat cross-border telephone fraud from Myanmar, with plans to be the first in the nation to build such a system to improve investigation efficiency.

Reported impact

Elderly people have suffered losses from various scams including AI face-swapped livestreams, swindling, fake medicines, and counterfeit antiques promoted in livestream rooms.

Index analysis

The incident reflects broader criminal adaptation to technology, with scammers exploiting AI deepfake capabilities to conduct fraud at scale. Authorities recognize the need to use AI countermeasures against such abuse.

Governance controls

A national lawmaker proposed strengthening protections for elderly people by adding a chapter on "inducing consumer fraud" to elderly rights protection laws with enhanced penalties.

Guangxi authorities are researching the use of AI to improve anti-fraud defenses, including development of specialized large language models for detecting cross-border fraud.

Classification

Category
Fraud, scams and manipulation
Industry
Media, social platforms and marketing
Country
China
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Economic or property, Human or fundamental rights
Harmed
Consumers, General public
Failure modes
Deepfake video
AI systems
Deepfake technology

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident