Skip to content
Submit incident
AII-1001-97883
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

OpenAI disrupts covert influence campaigns tied to China, North Korea, Russia and Iran

OpenAI reported that it disrupted covert influence and cyber operations by China, North Korea, Russia and Iran using ChatGPT and Sora for propaganda, social engineering, phishing and surveillance. The company banned the associated accounts and stated there is little evidence the AI use increased operational reach compared to traditional methods.

5 June 2025 Β· China Β· Misinformation and synthetic media
5 June 2025
AII-1001-978832 sources ↓
Quick facts
Category
Misinformation and synthetic media
Country
United States
Source
The Daily Caller
Date
5 June 2025
Drafted by
Raidu Incident Detection

What happened

OpenAI released a threat report on June 5, 2025 stating it had disrupted multiple covert influence and cyber operations tied to foreign actors including China, North Korea, Russia and Iran, and banned associated accounts.

Chinese actors used ChatGPT to create content for social media platforms including TikTok, Reddit, X and Facebook, generating posts criticizing U.S. foreign policy and tariffs, impersonating both sides of American culture war debates, and creating fake sock puppet accounts. Operationally named campaigns included 'Sneer Review', which mass-produced short political comments in multiple languages, and attacks on a Taiwanese video game called 'Reversed Front' that contains anti-CCP themes.

Chinese operators also used ChatGPT to generate phishing emails, translate propaganda into Spanish for Latin American outlets, create fake biographies for fake social media accounts posed as journalists, and produce internal-style documents on self-discipline for Chinese public security organizations.

Reported impact

OpenAI representatives told reporters there is little evidence that the use of AI resulted in greater reach or impact than traditional methods.

Governance controls

OpenAI shut down a number of covert influence and cyber operations and banned accounts tied to malicious use of its AI models, halting four operations likely tied to the Chinese communist regime.

Classification

Category
Misinformation and synthetic media
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Public interest
Harmed
General public
Failure modes
Manipulation or dark pattern
Consequences
Content removal
AI systems
ChatGPT, Sora

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

The Daily Caller
AI Company Plays Wack-A-Mole To Keep Chinese Propagandists From Using ChatGPT To Sow Division In American Politics
5 June 2025
www.theepochtimes.com
OpenAI Bans Accounts Tied to Chinese, North Korean Cyber Schemes
5 June 2025
Oct 2026AI-generated deepfake videos spread on TikTok in Russian disinformation campaign targeting UkraineConfirmedMisinformation and synthetic mediaΠ£ΠšΠ Π†ΠΠ€ΠžΠ ΠœΠ’ΠΈΡΠΎΠΊΠΈΠΉ Π—Π°ΠΌΠΎΠΊSep 2026AI Chatbots Amplify Misinformation from Partisan "Pink Slime" News SitesConfirmedMisinformation and synthetic mediaPChome Online ζ–°θžYahoo News (Taiwan)δΈ­εœ‹ε ± China Press+5Sep 2026Russia uses AI-generated ads on Meta and Google to recruit foreign fighters for Ukraine warReportedMisinformation and synthetic mediah.uaZN.UASep 2026AI-generated images of Trump and White House aide went viralConfirmedMisinformation and synthetic mediawashingtonpost.comSep 2026Trump shares AI-generated image falsely depicting Robert De Niro as MAGA supporterReportedMisinformation and synthetic mediaThe IndependentRadarOnline