Skip to content
Submit incident
AII-1002-45127
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

AI-generated voice of São Paulo governor used in credit card cashback scam

Scammers used AI-generated voice and image to impersonate São Paulo Governor Tarcísio de Freitas in a video promoting a false credit card cashback scheme. The video directed victims to a fraudulent website to steal personal and banking information. Police opened an investigation into the voice cloning and fraud.

13 September 2024 · Secretaria de Segurança Pública · Fraud, scams and manipulation
13 September 2024
AII-1002-451277 sources ↓
Quick facts
Category
Fraud, scams and manipulation
Country
Brazil
Source
Exame
Date
13 September 2024
Drafted by
Raidu Incident Detection

What happened

Scammers used artificial intelligence to recreate the voice and image of Tarcísio de Freitas, Governor of São Paulo, in a video that circulated on the internet.

The video falsely claimed that São Paulo's Procon consumer protection agency had issued a fine against all credit card companies, obliging them to return money to consumers as a cashback. The fake video directed users to click a link mimicking a Procon-SP website, where they were prompted to provide personal and banking information under the pretense of receiving the promised refund.

Reported impact

The scam targeted consumers seeking to claim the false cashback promised in the video. Victims who clicked the fraudulent link were compromised, having disclosed personal and banking information to scammers.

Index analysis

The Procon-SP and other São Paulo government agencies do not conduct credit card cashback campaigns, and confirmed the information in the video was false.

Governance controls

The São Paulo government's Public Security Secretariat identified the scam and opened a police investigation to identify those responsible for the cybercrime involving unauthorized use of AI to falsify the governor's voice.

Classification

Category
Fraud, scams and manipulation
Industry
Financial and insurance services
Country
Brazil
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Economic or property, Reputational
Harmed
Consumers, Government
Failure modes
Voice clone, Deepfake image, Deepfake video, Manipulation or dark pattern
Consequences
Police investigation
AI systems
Voice synthesis system

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Exame
Voz de Tarcísio é recriada com IA para aplicar fraude nas redes sociais
13 September 2024
UOL notícias
Golpistas usam IA para recriar voz do governador Tarcísio e aplicar golpe
13 September 2024
O Globo
Voz de Tarcísio é recriada por IA para aplicar golpes, polícia abre inquérito para investigar o tema
13 September 2024
Valor Econ├┤mico
Voz de Tarcísio de Freitas é modificada por inteligência artificial para aplicar golpes
13 September 2024
VEJA
Polícia apura uso de IA para falsificar voz de Tarcísio em golpes em SP | Maquiavel
13 September 2024
Estadão
Governo alerta para golpe que usa inteligência artificial para simular voz de Tarcísio de Freitas
13 September 2024
O Diário
Golpistas recriam voz do governador Tarcísio para aplicar fraude nas redes sociais
13 September 2024