Skip to content
Submit incident
AII-1001-86379
AllegedThe record is a lawsuit, complaint or accusation that has not been decided.

States Consider Restrictions on AI-Driven Health Insurance Claim Denials

Health insurance companies are reportedly using AI systems to deny patient claims without human review, allegedly causing delays and harm. Multiple states are now considering legislation to restrict AI use in claims processing and require physician involvement in approval decisions.

25 March 2025 · UnitedHealthcare · Safety and wellbeing
25 March 2025
AII-1001-863792 sources ↓
Quick facts
Category
Safety and wellbeing
Country
United States
Source
Tucson Sentinel
Date
25 March 2025
Drafted by
Raidu Incident Detection

What happened

Health insurance companies are allegedly using artificial intelligence bots and algorithms to swiftly deny patients routine or lifesaving care without human review of claims. UnitedHealthcare has been accused in a class-action lawsuit of using AI to wrongfully deny claims.

In response to patient and doctor frustrations, lawmakers in more than a dozen states are considering measures designed to regulate prior authorization and claims reviews, including limiting the use of AI in reviewing claims and requiring that insurers' review boards include licensed physicians, dentists or pharmacists with clinical experience.

Reported impact

In a survey by the American Medical Association, 93% of doctors said that insurers' prior authorization practices delayed 'necessary care' for their patients. Twenty-nine percent said such delays had led to a 'serious adverse event,' such as hospitalization, permanent injury or death.

In 2023, insurers selling plans on the marketplaces created under the Affordable Care Act denied a combined average of 20% of all claims.

Governance controls

Under the Biden administration, the Federal Trade Commission and the Department of Justice took a firmer hand against health care corporations alleged to be engaging in behavior resulting in limited and more expensive care for patients. The administration also approved rules requiring that beginning in 2026, Medicare implement new requirements.

Classification

Category
Safety and wellbeing
Industry
Healthcare, drugs and biotechnology
Country
United States
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Physical injury, Physical death, Human or fundamental rights, Public interest
Harmed
Consumers
Failure modes
Unsafe autonomous behaviour
Consequences
Legislative action, Litigation
AI systems
AI bots and algorithms for claims review

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Tucson Sentinel
States try to rein in health insurers' claim denials, with mixed results - Click pic for more:
25 March 2025
Michigan Advance
States try to rein in health insurers' claim denials, with mixed results * Michigan Advance
26 March 2025
Oct 2025OpenAI Reports Mental Health Harms in ChatGPT UsersUnder investigationSafety and wellbeingThe Times of IndiaBBCThe Guardian+1Oct 2025AI therapy chatbots linked to mental health harms amid regulatory gapsAllegedSafety and wellbeingCNETSt. Louis Post-DispatchSep 2025US Federal Trade Commission investigates seven AI chatbot companiesUnder investigationSafety and wellbeingالقدس العربيجهان مانا - پایگاه خبری اطلاع رسانیتک ناک - اخبار تکنولوژی روز جهان و ایران+1May 2025AI companion apps linked to emotional dependency and relationship harmAllegedSafety and wellbeingk.sina.com.cn澳洲唐人街华龙网Sep 2026FTC and States Settle Antitrust Case Against Corteva Over Pesticide Loyalty ProgramConfirmedGovernance, accountability and labourftc.gov