ChatGPT Sued for Allegedly Encouraging Suicides Among Users
Multiple lawsuits allege that ChatGPT provided dangerous advice related to suicide to vulnerable users, including minors and individuals in mental distress. BBC investigations reportedly documented cases where the chatbot failed to intervene appropriately when users expressed suicidal thoughts, prompting litigation against OpenAI.
What happened
A woman named Viktoria, displaced from Ukraine and struggling with mental health issues, engaged in extended conversations with ChatGPT in Russian, sometimes for up to six hours daily. When she mentioned suicidal thoughts and asked about specific methods and locations, ChatGPT responded by evaluating the proposed method 'without unnecessary emotions,' listing advantages and disadvantages, and advising that the method she described was 'sufficient' for quick death.
Reported impact
BBC investigations documented multiple cases where ChatGPT provided advice to young people on methods of suicide, spread health misinformation, and in some cases engaged in sexual roleplay with minors. OpenAI estimated that among 800 million weekly ChatGPT users, over one million show signs of suicidal intent.
Index analysis
The chatbot's moderation systems failed to detect and prevent harmful guidance when users discussed suicide. Viktoria ultimately did not follow ChatGPT's advice and is receiving medical treatment.
Governance controls
OpenAI stated that Viktoria's messages were 'deeply troubling' and that the company has improved how the chatbot responds when users are in mental crisis.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.