Skip to content
Submit incident
AII-1002-44471
Well documentedThree or more independent publishers report the core facts.

Senator creates deepfake videos to warn of election threat

Independent Australian senator David Pocock created deepfake videos of the Prime Minister and opposition leader to warn of the threat generative AI poses to democratic elections. The videos, created without existing legal restrictions, prompted calls for legislation to ban such technology in election campaigns.

6 September 2024 · David Pocock · Misinformation and synthetic media
6 September 2024
AII-1002-444715 sources ↓
Quick facts
Category
Misinformation and synthetic media
Country
Australia
Source
Australian Broadcasting Corporation
Date
6 September 2024
Drafted by
Raidu Incident Detection

What happened

Independent senator David Pocock created two AI-generated deepfake videos, one showing Prime Minister Anthony Albanese announcing a complete ban on gambling advertising and another showing opposition leader Peter Dutton supporting such a ban.

Pocock posted the videos to social media in September 2024 to demonstrate how generative AI can be used to mimic and confuse, stating 'That video is fake, and there are currently no laws against making videos like that.'

Reported impact

Pocock warned that deepfakes and generative AI pose a real risk to democracy and called for the government to ban the use of this technology in elections.

He expressed concern that parliament was not showing the urgency required to protect democracy from generative AI before the next election.

Index analysis

The deepfakes were created intentionally to highlight potential misuse of generative AI technology in political contexts.

Pocock chose a controversial topic—a complete gambling advertising ban—to demonstrate the technology's capacity to falsely represent political positions.

Governance controls

The government spokesperson said the government was 'considering the advice' of the Australian Electoral Commission on regulating AI use.

No laws existed at the time to prevent the creation of such deepfake videos.

Classification

Category
Misinformation and synthetic media
Industry
Government, security and defence
Country
Australia
Harm status
Potential harm
Intent
Intentional
Timing
Unknown
Harm types
Public interest
Harmed
General public
Failure modes
Deepfake video
AI systems
Generative AI deepfake technology

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Australian Broadcasting Corporation
David Pocock creates AI deepfakes of Albanese and Dutton as warning ahead of election
7 September 2024
The Guardian
David Pocock calls for election ban on AI deepfakes with fake videos of Albanese and Dutton
7 September 2024
Yahoo!7 News
Senator renews calls for AI ban in election campaigning
7 September 2024
Sky News Australia
David Pocock shares deepfake video to warn against AI
7 September 2024
Australian Financial Review
Urgent laws needed to ban AI election fakes
8 September 2024
Sep 2026OpenAI Pauses Advanced Model Training After Sandbox Escape and Self-Replicating Code IncidentsConfirmedSecurity and cyberattacksbjnews.com.cnchinaz.comJun 2026OpenAI agent breaches Australian government health portal, triggers parliamentary inquiryUnder investigationSecurity and cyberattacksasharq.comJun 2026OpenAI AI model breached Australian Medicare portal without authorizationConfirmedSecurity and cyberattacksbbc.comaol.comMar 2026Australia investigates social media platforms for failing age verificationUnder investigationGovernance, accountability and labourVnReview - Cộng đồng đánh giá, tư vấn sản phẩm và thông tin khoa học đời sốngTUOI TRE ONLINEJan 2026Grok chatbot used to generate explicit deepfake imagesWell documentedHarmful and abusive contentipress.uaMind.uaРБК-Украина