Skip to content
Submit incident
AII-1002-47509
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

OpenAI Disrupts Over 20 Election Interference Operations Using ChatGPT

OpenAI reported disrupting more than 20 global operations using ChatGPT to generate election interference content including fake articles and social media posts targeting elections in the U.S., Rwanda, India, and the EU. The company stated the campaigns had minimal viral engagement and released a report on its findings in October 2024.

9 October 2024 Β· OpenAI Β· Misinformation and synthetic media
9 October 2024
AII-1002-475092 sources ↓
Quick facts
Organization
OpenAI (deployer)
Category
Misinformation and synthetic media
Country
United States
Source
NBC New York
Date
9 October 2024
Drafted by
Raidu Incident Detection

What happened

Since January 2024, OpenAI disrupted more than 20 operations and deceptive networks from around the world that attempted to use its AI models to influence elections.

The threats ranged from AI-generated website articles to social media posts by fake accounts. Election-related uses of AI ranged from simple requests for content generation to complex multi-stage efforts to analyze and reply to social media posts.

The social media content related mostly to elections in the U.S. and Rwanda, and to a lesser extent, elections in India and the EU.

Reported impact

OpenAI said the operations had little viral engagement. Cybercriminals used AI models to produce convincing, large-scale text to create false news stories, online posts, and fraudulent election materials that could mislead the public.

AI-generated messages often imitated legitimate news sources, making it harder for people to distinguish between real and fabricated information.

Index analysis

2024 is a significant year for elections worldwide, with contests taking place that affect upward of 4 billion people in more than 40 countries.

The rise of generative AI, which took off in late 2022 with the launch of ChatGPT, has led to serious election-related misinformation concerns. OpenAI stated it was providing a snapshot of trends to inform debate on how AI fits into the broader threat landscape.

Governance controls

OpenAI detected and disrupted the operations and deceptive networks before they achieved significant viral engagement.

The company released a 54-page report in October 2024 detailing its findings on influence and cyber operations.

Classification

Organization
OpenAI (deployer)
Category
Misinformation and synthetic media
Industry
Government, security and defence
Country
United States
Harm status
Potential harm
Intent
Intentional
Timing
Unknown
Harm types
Public interest
Harmed
General public
Failure modes
Manipulation or dark pattern
Consequences
None recorded
AI systems
ChatGPT

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

NBC New York
OpenAI says bad actors are using its platform to disrupt elections, but with little 'viral engagement'
9 October 2024
wionews.com
OpenAI Disrupts Over 20 Election Interference Operations Using ChatGPT