Skip to content
Submit incident
AII-1001-83859
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

AI Search Engines Fabricate News Citations, Undermining Publishers

A study by the Columbia Journalism Review and Tow Center for Digital Journalism found that AI search engines frequently provide incorrect answers with false or missing citations, with error rates averaging 60% across eight tested models. The tools fail to credit original publishers and instead fabricate links, threatening the integrity of online information and publisher revenues.

11 March 2025 · OpenAI · Reliability and hallucination
11 March 2025
AII-1001-838594 sources ↓
Quick facts
Category
Reliability and hallucination
Country
United States
Source
TechSpot
Date
11 March 2025
Drafted by
Raidu Incident Detection

What happened

A study by the Columbia Journalism Review examined eight AI search models and found that in 60% of cases, responses were incorrect. Grok 3 performed worst with a 94% error rate, while Perplexity achieved a 37% error rate.

The study tested ChatGPT Search and found it cited wrong sources in nearly 40% of cases and provided no sources at all in 21% of responses. AI search engines aspirate and reformulate publisher content without crediting original authors, instead displaying syndicated or fabricated links.

Reported impact

Users receive incorrect information presented with absolute confidence, creating an illusion of reliability when answers are entirely wrong. Paid versions of these AI tools show even higher error rates despite expectations of better performance.

Publishers lose traffic as AI search engines redistribute content without directing users to original sources, threatening the economic viability of news organizations and the integrity of online information.

Index analysis

The failure modes involve systematic hallucination and citation fabrication across mainstream search tools, with error rates significantly above acceptable thresholds for information-providing systems.

Classification

Category
Reliability and hallucination
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Public interest, Economic or property, Reputational
Harmed
General public, Business
Failure modes
Hallucination, Fabricated citation
AI systems
ChatGPT, Gemini, Perplexity, Grok 3, LeChat

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

TechSpot
New study finds that AI search tools are 60 percent inaccurate on average
11 March 2025
Developpez.com
Les moteurs de recherche basés sur l'IA échouent au test de précision, avec un taux d'erreur de 60 %, atteignant même 96 % pour Grok-3, selon une étude du Tow Center for Digital Journalism
13 March 2025
futura-sciences.com
AI Search Engines Fabricate News Citations, Undermining Publishers
journaldunet.com
AI Search Engines Fabricate News Citations, Undermining Publishers