Skip to content
Submit incident
AII-1001-97971
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.Supporting sources are pending verification.

OpenAI reports Chinese groups using ChatGPT for covert influence campaigns

OpenAI reported that Chinese groups are increasingly using ChatGPT for covert operations including influence campaigns, cyber operations support, and fake content generation. The operations detected were small in scale and targeted limited audiences, but involved expanded tactics across social media and political discourse.

5 June 2025 Β· Chinese groups Β· Misinformation and synthetic media
5 June 2025
AII-1001-97971
Quick facts
Category
Misinformation and synthetic media
Country
China
Date
5 June 2025
Drafted by
Raidu Incident Detection

What happened

OpenAI reported in June 2025 that Chinese groups are using ChatGPT for covert operations. The scope and tactics of these groups have expanded, though operations detected were generally small in scale and targeted limited audiences.

OpenAI banned ChatGPT accounts that generated social media posts on political and geopolitical topics relevant to China, including criticism of a Taiwan-centric video game, false accusations against a Pakistani activist, and content about USAID closure. Posts also criticized U.S. President Donald Trump's tariffs.

China-linked threat actors used ChatGPT to support cyber operations, including open-source research, script modification, system troubleshooting, and development of tools for password brute forcing and social media automation. A China-origin influence operation generated polarized social media content supporting both sides of divisive U.S. political topics, including AI-generated profile images.

Reported impact

The operations reached limited audiences and were small in scale according to OpenAI's findings.

Governance controls

OpenAI regularly releases reports on malicious activity detected on its platform. The company detected and banned accounts engaged in these covert operations.

Classification

Category
Misinformation and synthetic media
Industry
Media, social platforms and marketing
Country
China
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Public interest
Harmed
General public
Failure modes
Manipulation or dark pattern, Content moderation failure
Consequences
Content removal
AI systems
ChatGPT

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident