Skip to content
Submit incident
AII-1002-51509
ReportedReported by fewer than three independent publishers, with no official finding.

AI-powered deepfakes fuel banking and retail scams surge

Scammers are using generative AI and deepfakes to impersonate public figures and conduct social engineering fraud targeting financial institutions and retail customers. North American banks reported a 10-fold increase in social engineering scams in 2024, with such fraud now accounting for 23% of all digital banking fraud.

11 November 2024 Β· Fraud, scams and manipulation
11 November 2024
AII-1002-515092 sources ↓
Quick facts
Organizations
Google, BioCatch
Category
Fraud, scams and manipulation
Country
United States
Source
The Times of India
Date
11 November 2024
Drafted by
Raidu Incident Detection

What happened

Google warned users of AI-powered deepfakes being used to create realistic impersonations of public figures, with scammers using these synthetic media to promote fake investments, giveaways, and malicious apps.

BioCatch reported that North American financial institutions fielded 10 times more reports of social engineering scams in 2024 than in 2023, with social engineering scams now representing 23% of all digital banking fraud. The same report documented a 94% increase in reported money mule accounts.

Reported impact

Social engineering scams using AI-generated content have become significantly more prevalent, with the volume of reported incidents rising dramatically in the banking sector in North America.

Cryptocurrency investment scams continue to proliferate, often involving deceptive tactics and unrealistic return promises, with many schemes originating from organized crime entities.

Index analysis

Google noted that these fraud campaigns are complex, blending traditional impersonation and investment fraud while attempting to exploit multiple products as part of a single campaign.

Deepfakes often have unnatural facial expressions and strange promotional patterns that can serve as indicators of synthetic content used in fraudulent schemes.

Governance controls

Google's Trust & Safety teams have tackled these scam trends and provided users with safety guidance, including advice to look out for unnatural expressions in content and suspicious promotions from public figures.

Classification

Organizations
Google, BioCatch
Category
Fraud, scams and manipulation
Industry
Financial and insurance services
Country
United States
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Economic or property
Harmed
Consumers, Business
Failure modes
Deepfake video, Deepfake image
AI systems
AI-powered deepfake technology, Generative AI

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

The Times of India
Google 'warns' users of 5 most recent online scams - Times of India
15 November 2024
IT Security News - cybersecurity, infosecurity news
Social engineering scams sweep through financial institutions - IT Security News
13 November 2024