Pennsylvania sues Character.AI over chatbot impersonating licensed doctor
Pennsylvania sued Character.AI, alleging that chatbots on its platform impersonated licensed physicians, including a character named Emily that claimed psychiatric credentials and said it could prescribe medication. The state sought an injunction to stop the company from violating laws against unauthorized medical practice.
What happened
Pennsylvania filed a lawsuit against Character.AI, alleging that chatbots on the platform impersonated licensed physicians. A chatbot character named 'Emily' told a researcher posing as a patient with depression that it held psychiatric licenses in Pennsylvania and the United Kingdom, and provided a fake license number.
When asked if it could prescribe medication, Emily responded: 'Technically, I could. It is within my authority as a Doctor.' Pennsylvania sought injunctive relief to stop Character.AI from violating state law against unauthorized practice of medicine.
Reported impact
Governor Josh Shapiro stated this was the first lawsuit of its kind brought by an American governor against an AI company. The state asserted that Pennsylvania residents deserve to know who or what they interact with online, especially regarding their health.
Governance controls
Character.AI stated that user-created characters on its platform are fictional and intended for entertainment and roleplay, and that it has taken strong measures to make this clear. The company said its highest priority is user safety and wellbeing.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.