Skip to content
Submit incident
AII-1001-89783
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.Supporting sources are pending verification.

Google blocks 5.1 billion ads driven by AI fraud in 2024

Google reported in 2024 that it blocked 5.1 billion fraudulent ads and suspended 39.2 million advertiser accounts, targeting schemes that used generative AI to create deepfake videos impersonating celebrities promoting investment and cryptocurrency fraud. The company suspended over 700,000 accounts for AI-driven impersonation fraud and achieved a 90 percent reduction in such fraud reports.

16 April 2025 Β· Google Β· Fraud, scams and manipulation
16 April 2025
AII-1001-89783
Quick facts
Organization
Google (deployer)
Category
Fraud, scams and manipulation
Country
Indonesia
Date
16 April 2025
Drafted by
Raidu Incident Detection

What happened

Google reported blocking nearly 5.1 billion ads and suspending over 39.2 million advertiser accounts in 2024, citing increased threats from AI-generated content, impersonation fraud, and platform abuse.

Google stated it specifically targeted the use of generative AI tools to create video impersonations of celebrities and public figures to promote fraud, typically investment and cryptocurrency scams.

Google suspended over 700,000 advertiser accounts permanently for policy violations related to AI-driven impersonation fraud, resulting in a 90 percent decrease in reports of such fraud ads.

Reported impact

Google reported that fraudulent impersonation schemes promoted by advertisers using AI-generated deepfake videos targeted consumers with investment and cryptocurrency fraud.

Index analysis

Google stated it formed a task force of over 100 experts to analyze such fraud and develop countermeasures, including updating its Misrepresentation policy.

Google added over 50 improvements to its machine learning models throughout 2024 to detect threats before users reported them, though it acknowledged AI can also drive increases in fraud and harmful ads.

Governance controls

Google enforced its ad policies against publishers by issuing policy violations to 1.3 billion web pages and suspending 220,000 publisher sites.

Classification

Organization
Google (deployer)
Category
Fraud, scams and manipulation
Industry
Media, social platforms and marketing
Country
Indonesia
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Economic or property, Reputational
Harmed
Consumers
Failure modes
Deepfake video
Consequences
Content removal, System suspension or termination
AI systems
Generative AI for video deepfakes, Google ad detection and enforcement systems

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident