Deepfake AI tools enable sexual abuse material, identity fraud across East Asia
Deepfake AI tools including voice synthesis and video generation platforms are being weaponized in East Asia to create non-consensual sexual imagery, commit identity fraud through account takeovers, and facilitate romance scams and money laundering. Identity verification service providers have responded by deploying enhanced detection systems to counter increasingly sophisticated analog and digital impersonation methods.
What happened
Generative AI tools including voice synthesis services from ElevenLabs and video generation platforms from Synthesia, D-ID, and HourOne are being misused to create deepfake content across East Asia.
Malicious actors use these tools to create fraudulent images and videos for identity impersonation in account openings, including dating apps and financial services. Malware bots on Telegram reportedly generate non-consensual sexual imagery using AI technology.
Reported impact
Identity fraud schemes using deepfakes have led to money laundering, unauthorized bank account access, credit card fraud, and romance scams. In South Korea, educators report concerns that deepfake misuse poses risks in contexts like school yearbook production.
Fraudsters employ both analog methods (displaying fake media on phones or screens) and digital methods (embedding fake images and videos into websites and mobile apps) to deceive identity verification systems.
Index analysis
Deepfake creation tools have become accessible to broad audiences as generative AI technology advances, with low-cost availability making harmful use widespread. Most existing detection systems rely on passive judgment from single facial images, but emerging digital deception techniques bypass these safeguards.
Service providers in the identity verification sector have strengthened defenses by developing new deepfake detection features, including passive judgment capabilities that authenticate real-time facial capture without requiring additional user actions.
Governance controls
Liquid's online identity verification service LIQUID eKYC deployed enhanced deepfake detection using image recognition and AI analysis of 50 million cumulative identity verification records. The company developed passive judgment technology and flash-based forgery detection systems to counter both analog and digital impersonation attempts.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.