Skip to content
Submit incident
AII-1002-00439
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

NHS warns against non-compliant AI transcription tools in clinical use

NHS England instructed healthcare providers to stop using AI transcription tools that fail to meet national safety and data protection standards. Some Ambient Voice Technology systems in widespread clinical use lack required governance compliance, raising risks of data breaches and patient safety issues.

23 June 2025 Β· Ambient Voice Technology Β· Privacy and surveillance
23 June 2025
AII-1002-004393 sources ↓
Quick facts
Category
Privacy and surveillance
Country
United Kingdom
Source
Cybernews
Date
23 June 2025
Drafted by
Raidu Incident Detection

What happened

NHS England instructed healthcare providers to stop using AI transcription tools that fail to meet national standards. Following an investigation cited by Sky News, several Ambient Voice Technology (AVT) solutions used in patient consultations were found to not meet NHS governance requirements on data protection and clinical safety.

A letter from the national chief clinical information officer stated that several AVT solutions were still in widespread use within clinical practice despite being non-compliant. The letter also noted that a number of AVT suppliers had been approaching NHS organisations, although many of these vendors had not met the basic governance standards set by the NHS.

Reported impact

NHS England cautioned that continued use of these non-compliant systems could lead to data breaches, safety risks, financial exposure, and misalignment with the government's national digital strategy. A cyber intrusion had reportedly exposed patient data at University College London Hospitals and University Hospital Southampton after attackers exploited a newly identified software vulnerability.

Index analysis

Healthcare leaders raised concerns over the limited capacity of NHS clinicians to assess whether AI tools meet safety and privacy standards. The British Medical Association's GP committee deputy chair called for NHS England to provide help and support to check that products are safe, secure, and suitable for use in the consulting room.

Governance controls

Earlier in the year, NHS England issued guidance supporting the adoption of AVT to reduce administrative workload, with strict governance and safety requirements including data security protocols, patient confidentiality measures, and compliance with clinical safety standards. The guidance, published in April in coordination with the Department of Health and Social Care, was part of a broader strategy to integrate advanced AI technologies across NHS services.

Classification

Category
Privacy and surveillance
Industry
Healthcare, drugs and biotechnology
Country
United Kingdom
Harm status
Potential harm
Intent
Unintentional
Timing
Post-deployment
Harmed
Consumers
Consequences
System suspension or termination
AI systems
Ambient Voice Technology (AVT) systems
Regulations
GDPR (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Cybernews
NHS demands doctors stop using unapproved AI software for conversation recording
24 June 2025
Sky News
Doctors are using unapproved AI software to record patient meetings, investigation reveals
24 June 2025
Tech Monitor
NHS warns against non-compliant AI transcription tools in clinical use
25 June 2025