Skip to content
Submit incident
AII-1002-51101
ReportedReported by fewer than three independent publishers, with no official finding.Supporting sources are pending verification.

Deepfake audio fuels deceptive political ads on hacked Facebook pages

A network operating as Patriot Democracy hijacked over 340 Facebook pages to run over 160,000 deceptive political ads that used deepfake audio of prominent politicians and falsely promised financial rewards. The ads redirected users to forms collecting personal information that was sold to telemarketers or used in fraud. Meta's content moderation failed to catch thousands of the ads despite loopholes in its enforcement processes being documented by investigators.

4 November 2024 Β· Patriot Democracy Β· Misinformation and synthetic media
4 November 2024
AII-1002-51101
Quick facts
Category
Misinformation and synthetic media
Country
United States
Date
4 November 2024
Drafted by
Raidu Incident Detection

What happened

A network called Patriot Democracy hijacked over 340 Facebook pages, including verified accounts such as that of Fox News meteorologist Adam Klotz, to run deceptive political ads.

The ads exploited deepfake audio of prominent figures like Donald Trump and Joe Biden and falsely promised financial rewards, redirecting users who clicked to forms requesting personal information that was subsequently sold to telemarketers or used in fraudulent schemes.

The network pushed over 160,000 deceptive ads related to elections and social issues, with a combined reach of nearly 900 million views across Facebook and Instagram.

Reported impact

Users who clicked on the ads were redirected to forms requesting personal information, which was subsequently sold to telemarketers or used in fraudulent schemes.

The deceptive ads achieved a combined reach of nearly 900 million views across Facebook and Instagram.

Index analysis

A ProPublica and Tow Center for Digital Journalism investigation uncovered significant loopholes in Meta's ad review and enforcement processes.

While Meta removed some of the ads, it failed to catch thousands of others with identical or similar content, and allowed associated pages to remain active, enabling perpetrators to continue operations by spawning new pages and running more ads.

Governance controls

Meta's policies require ads related to elections or social issues to carry 'paid for by' disclaimers identifying the entities behind them.

Meta later extended its ban on new political ads across Facebook and Instagram through Election Day in response to misinformation concerns.

Classification

Category
Misinformation and synthetic media
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Economic or property, Public interest
Harmed
Consumers, General public
Failure modes
Manipulation or dark pattern, Content moderation failure, Voice clone
AI systems
deepfake audio generation

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident