OpenAI reports Chinese groups misusing ChatGPT for hacking and disinformation
OpenAI reported discovering multiple Chinese groups using ChatGPT for covert operations including social media disinformation campaigns and cyber hacking support. The company banned the identified accounts, though it noted the detected operations were generally small-scale in scope.
What happened
OpenAI reported in June 2025 that it had identified an increasing number of Chinese groups using ChatGPT for covert operations. Although these groups' scope and methods were expanding, the detected operations were generally small-scale and targeted limited audiences.
One group of accounts posted on social media about China-related political and geopolitical topics, including criticism of a Taiwan-focused video game, false accusations against a Pakistani activist, and content about the closure of the U.S. Agency for International Development. In another case, hackers linked to China used ChatGPT to support various stages of their cyber operations, including open-source research, text modification, system configuration troubleshooting, password cracking tool development, and social media automation.
Reported impact
The discovered operations involved disinformation campaigns on social media and cyber intrusion activities. While the scale was limited, the activities demonstrated the use of generative AI for both propaganda and technical hacking support.
Index analysis
Concerns about generative AI capable of producing human-like text, images and audio have existed since ChatGPT's launch in late 2022. OpenAI regularly issues reports on harmful activities detected on its platform, including malware creation and removal, and creation of fake website and social media content.
Governance controls
OpenAI banned the identified ChatGPT accounts used in these operations.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.