Skip to content
Submit incident
AII-1002-06059
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

AI-Generated Deepfake Videos in Pix Scam Removed from Facebook After Government Action

Fraudulent Facebook posts using AI-generated deepfake videos were removed after Brazil's Attorney General's Office (AGU) sent a formal notice. The videos falsely depicted reactions to manipulated statements by Central Bank officials and promoted a fake Pix compensation scheme designed to steal personal data.

23 July 2025 · Facebook · Fraud, scams and manipulation
23 July 2025
AII-1002-060597 sources ↓
Quick facts
Category
Fraud, scams and manipulation
Country
Brazil
Source
Governo do Brasil
Date
23 July 2025
Drafted by
Raidu Incident Detection

What happened

Facebook posts containing AI-generated deepfake videos were removed on 23 July 2025 after the Advocacia-Geral da União (AGU) sent a formal notice to the platform. The videos depicted fake reactions from AI-generated people to manipulated statements made by Gabriel Galípolo, president of the Central Bank, and Paulo Picchetti, director of international affairs at the Central Bank.

The fraudulent posts promoted a false 'financial compensation' for all Pix users, designed to direct victims to a website for collection of personal data. One post using a fake G1 news portal account received over 3,100 likes before being removed.

Reported impact

The scam targeted Pix users by falsely claiming they were entitled to compensation and falsely alleging a data breach. The Procuradoria Nacional da União de Defesa da Democracia (PNDD) noted the videos had fraudulent potential and sought to damage public policy and the integrity of state action.

Index analysis

The PNDD argued in its notice that the videos violated Facebook's own terms of use and that digital platforms can be held responsible for disseminating fraudulent and misleading content, particularly following a recent Supreme Court decision on the Internet Civil Mark. The notice identified that the videos infringed the integrity of public action and targeted a key government policy.

Governance controls

Facebook complied with the AGU's extrajudicial notice by removing the posts and similar content from both Facebook and Instagram within one day of notification. The PNDD specifically requested removal of the listed posts and others containing the manipulated videos of Central Bank officials.

Classification

Category
Fraud, scams and manipulation
Industry
Financial and insurance services
Country
Brazil
Harm status
Potential harm
Intent
Intentional
Timing
Unknown
Harm types
Economic or property, Public interest
Harmed
Consumers, General public, Government
Failure modes
Deepfake video, Manipulation or dark pattern
Consequences
Content removal
AI systems
AI Video Generation System
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Governo do Brasil
Facebook remove vídeos sobre PIX manipulados por IA após notificação da AGU
23 July 2025
Portal O Dia
Facebook remove vídeos falsos sobre 'compensação financeira' do Pix - Portal O Dia
23 July 2025
Correio Braziliense
Pix: vídeos manipulados por IA são excluídos após notificação da AGU
23 July 2025
Portal meionews.com
AGU retira vídeos falsos sobre Pix no Facebook
23 July 2025
ConvergenciaDigital
AGU usa decisão do STF sobre Marco Civil para remover fraudes com IA e PIX no Facebook - ConvergenciaDigital
24 July 2025
Extra Online
Após notificação da AGU, Facebook remove vídeos sobre PIX manipulados por inteligênia artificial
24 July 2025
Mobile Time
Facebook obedece AGU e derruba post com fraude de Pix
24 July 2025