Skip to content
Submit incident
AII-1002-05863
Well documentedThree or more independent publishers report the core facts.

FDA's Elsa AI tool fabricates research studies

The FDA's Elsa AI tool, unveiled to accelerate drug approvals, reportedly hallucinates and misrepresents research studies according to current FDA employees. The tool cannot reliably support critical drug review work due to access limitations and the need for staff to extensively verify its outputs.

23 July 2025 Β· FDA Β· Reliability and hallucination
23 July 2025
AII-1002-058634 sources ↓
Quick facts
Category
Reliability and hallucination
Country
United States
Source
CNN International
Date
23 July 2025
Drafted by
Raidu Incident Detection

What happened

The FDA's Elsa AI tool, intended to speed up drug and medical device approvals, has hallucinated and misrepresented research, according to three current FDA employees and documents reviewed by CNN.

The tool generates useful outputs like meeting notes and email templates, but cannot reliably assist with critical review work because it lacks access to industry submissions and company-specific information.

Reported impact

FDA employees report wasting extra time and requiring heightened vigilance to verify whether studies cited by Elsa actually exist or have been correctly represented.

Classification

Category
Reliability and hallucination
Industry
Healthcare, drugs and biotechnology
Country
United States
Harm status
Potential harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Public interest
Harmed
General public
Failure modes
Hallucination, Fabricated citation, Agent misaction
AI systems
Elsa

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

CNN International
FDA's artificial intelligence is supposed to revolutionize drug approvals. It's making up nonexistent studies.
23 July 2025
Gizmodo
FDA's New Drug Approval AI Is Generating Fake Studies: Report
23 July 2025
engadget
FDA employees say the agency's Elsa generative AI hallucinates entire studies
23 July 2025
Tech Times
FDA's Elsa AI Hallucinates Studies, Says Employees: Double-Checking Facts Is a Must
24 July 2025