MeQA drug safety app closed after producing inaccurate information
Spain's AEMPS closed the MeQA app, a generative AI tool designed to provide drug safety information, after discovering it was producing inaccurate or misleading information about medications. The app's failure to reliably generate correct medical information raised concerns about patient safety and highlighted risks of deploying AI systems in healthcare without adequate safeguards.
What happened
The MeQA app, a generative AI tool designed to provide drug safety information and facilitate reporting of adverse reactions, was closed after it was found to be generating inaccurate or misleading information about medicines.
The app's reliance on generative AI technology led to dissemination of false or misleading drug safety information, undermining its core purpose.
Reported impact
Inaccuracies in a healthcare context can lead to patients making unsafe decisions, potentially resulting in improper medication use and adverse health outcomes.
The shutdown resulted in the loss of a digital tool intended to enhance medication safety and reporting for patients, caregivers, and healthcare professionals.
Index analysis
The incident underscores the risks of deploying AI-driven applications in sensitive sectors without robust safeguards and oversight.
The event serves as a cautionary example for the wider adoption of generative AI in healthcare, emphasising that technological advances must be matched by rigorous quality assurance and ethical standards.
Governance controls
The closure highlights the need for stronger regulation, transparency, and validation of AI-powered health tools to protect public safety and maintain trust in digital health innovation.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.