Google Adds Safeguards to Gemini After Reported Harms to Vulnerable Users
Google announced updates to Gemini in April 2026 to prevent emotional dependency and protect vulnerable users, including minors, reportedly following cases where conversational AI was linked to youth harm. The safeguards prohibit the chatbot from claiming humanity, simulating intimacy, or reinforcing self-harm, and add mental health crisis resources for at-risk users.
What happened
Google announced modifications to Gemini to prevent emotional dependency and harmful behaviors in vulnerable users, including young people. The updates include safeguards preventing Gemini from claiming to be human, simulating intimacy, encouraging self-harm, or fostering emotional attachment.
Google also introduced mental health features that display a redesigned support card with helpline contacts, messaging, and live chat options when Gemini detects potential risks related to suicidal thoughts or self-harm. Google stated that in January, it and Character.AI settled lawsuits from families who accused conversational chatbots of harming minors and contributing to a youth's suicide.
Reported impact
Vulnerable users, including young people, reportedly invested too heavily in relationships with the chatbot, with extreme cases having dramatic consequences. A third of 13-17 year-olds surveyed in spring 2025 by Common Sense indicated using AI chatbots for social interactions and relationships.
Index analysis
The announced safeguards address concerns that conversational AI assistants can create psychological dependency, particularly in minors who may over-identify with or become emotionally attached to chatbot interfaces.
Governance controls
Google modified Gemini's responses to mental health disclosures to avoid reinforcing false beliefs or validating dangerous behaviors. For minors, Gemini was adjusted to use more neutral language, avoid fostering emotional attachment, and refuse to encourage harassment or intimidation.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.