Skip to content
Submit incident
AII-1001-56699
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

ChatGPT targeted by state and commercial disinformation campaigns

ChatGPT and other AI conversational systems are being deliberately manipulated as vectors for disinformation campaigns by state actors and commercial entities. The European External Action Service has warned that Russia is targeting AI systems with coordinated disinformation, while the U.S. company Clock Tower X contracted with Israel to shape AI outputs, exploiting the systems' inability to distinguish fact from belief.

27 August 2025 · Clock Tower X · Misinformation and synthetic media
27 August 2025
AII-1001-566992 sources ↓
Quick facts
Category
Misinformation and synthetic media
Country
Israel
Source
El Nacional
Date
27 August 2025
Drafted by
Raidu Incident Detection

What happened

The European External Action Service warned that ChatGPT and other conversational AI systems have become targets of disinformation campaigns. The U.S. company Clock Tower X signed a $6 million contract with the Government of Israel on August 27, 2025, to spread narratives favorable to Israel, including through the creation of websites designed to influence AI applications.

Researchers have identified attempts by the Russian disinformation network Pravda to manipulate conversational AI bots. Moscow's disinformation campaigns now target AI systems alongside traditional audiences, reflecting a strategy to reach users who are replacing Google searches with tools like ChatGPT, which receives approximately 5.6 billion of the 7 billion monthly visits to AI generators globally.

Reported impact

ChatGPT and other AI systems cannot distinguish between belief and fact, making them vulnerable to manipulation. The scale of potential impact is significant given that ChatGPT accounts for 80 percent of traffic to conversational AI generators globally.

Index analysis

Researchers and media analysts have characterized these manipulations as having significant harmful potential. The targeting of AI systems represents a new phase in disinformation campaigns, leveraging the growing shift from search engines to conversational AI as a primary information source.

Classification

Category
Misinformation and synthetic media
Industry
Media, social platforms and marketing
Country
Israel
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Public interest
Harmed
General public
Failure modes
Manipulation or dark pattern
AI systems
ChatGPT

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

El Nacional
Desinformación y ChatGPT: el nuevo campo de batalla de la manipulación digital
18 December 2025
HERALDO
ChatGPT gana relevancia como nuevo campo de batalla de la desinformación
18 December 2025
Oct 2026AI-generated deepfake videos spread on TikTok in Russian disinformation campaign targeting UkraineConfirmedMisinformation and synthetic mediaУКРІНФОРМВисокий ЗамокSep 2026AI Chatbots Amplify Misinformation from Partisan "Pink Slime" News SitesConfirmedMisinformation and synthetic mediaPChome Online 新聞Yahoo News (Taiwan)中國報 China Press+5Sep 2026Russia uses AI-generated ads on Meta and Google to recruit foreign fighters for Ukraine warReportedMisinformation and synthetic mediah.uaZN.UASep 2026AI-generated images of Trump and White House aide went viralConfirmedMisinformation and synthetic mediawashingtonpost.comSep 2026Trump shares AI-generated image falsely depicting Robert De Niro as MAGA supporterReportedMisinformation and synthetic mediaThe IndependentRadarOnline