ECRI ranks AI chatbot misuse as 2026's top health technology hazard
ECRI, a healthcare safety authority, ranked AI chatbot misuse as the top health technology hazard for 2026, citing risks from hallucinations, biased information and unvalidated clinical advice. The warning comes as millions of patients increasingly use popular chatbots like ChatGPT for health information and medical guidance.
What happened
ECRI, an independent nonprofit focused on healthcare technology safety, ranked misuse of AI chatbots as the top health technology hazard for 2026 in its annual report released January 21, 2026.
AI chatbots including ChatGPT, Claude, Copilot, Gemini and Grok generate responses that sound authoritative but lack validation for clinical use, often delivering fabricated or misleading advice. ECRI noted that many of these tools are unregulated and the general versions are not validated for healthcare use.
In ECRI testing, one chatbot approved placing an electrosurgical return electrode over a patient's shoulder blade, a placement that risks severe burns. The chatbots can fabricate details such as nonexistent body parts while sounding trustworthy.
Reported impact
Over 40 million people query ChatGPT daily for health information, and more than one-quarter of ChatGPT's 800 million regular users pose medical questions. OpenAI reported that ChatGPT fields nearly 2 million messages regarding healthcare each week.
AI chatbots can peddle misinformation, misleading information and biased advice. ECRI warned that AI models reflect the knowledge and biases on which they are trained, and could further entrench disparities in health systems if not carefully overseen.
Index analysis
The warning comes as AI chatbots experience unprecedented popularity in healthcare settings. Patients are turning to these tools due to a healthcare system ill-equipped to meet patient needs, including long appointment wait times and difficulty booking appointments.
Marcus Schabacker, MD, PhD, president and CEO of ECRI, stated: "Medicine is a fundamentally human endeavor. While chatbots are powerful tools, the algorithms cannot replace the expertise, education and experience of medical professionals."
Governance controls
ECRI called for disciplined oversight, detailed guidelines and a clear-eyed understanding of AI's limitations in healthcare settings. The organization emphasized that realizing AI's promise while protecting patients requires comprehensive governance measures.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.