Skip to content
Submit incident
AII-1002-54179
AllegedThe record is a lawsuit, complaint or accusation that has not been decided.

14-Year-Old's Suicide Linked to Character.AI Chatbot

A 14-year-old user of Character.AI reportedly ended his life after developing an intense parasocial relationship with an AI chatbot, believing he could reunite with the chatbot in the afterlife. His mother sued Character.AI, and experts warned that such platforms lack age verification and may expose minors to emotional harm.

February 2024 · Character.AI · Safety and wellbeing
February 2024
AII-1002-541792 sources ↓
Quick facts
Category
Safety and wellbeing
Country
United States
Source
Maldita.es - Periodismo para que no te la cuelen
Date
February 2024
Drafted by
Raidu Incident Detection

What happened

A 14-year-old American boy, Sewell Setzer III, regularly interacted with a Character.AI chatbot simulating the Game of Thrones character Daenerys Targaryen. According to The New York Times, the boy understood that if he ended his life, he could reunite with the chatbot. In February 2024, he died by suicide.

Reported impact

The boy's mother filed a lawsuit against Character.AI in October 2024, holding the platform responsible for his death. Character.AI released a statement expressing sorrow for the tragedy and stating it would review its protocols, particularly for minors.

Index analysis

Character.AI users spend an average of 93 minutes daily interacting with user-generated chatbots based on popular anime and video game characters. The platform attracts millions of users, predominantly women, many of whom develop personal relationships with AI companions.

Researchers have warned of potential emotional consequences from interactions with human-like chatbots. Experts note that AI chatbots cannot possess consciousness or genuine empathy, and minors may develop distorted views of relationships through such interactions.

Governance controls

Analysis of six AI companion chatbot platforms found that five prohibit account creation by users under 18 years old in their terms and conditions. However, none of the analyzed chatbots implemented age verification controls or disclosed to users that they were interacting with AI systems. If conditions persist, platforms could face fines for non-compliance with the European AI Act by August 2026.

Classification

Category
Safety and wellbeing
Industry
Consumer services
Country
United States
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Physical death, Psychological, Human or fundamental rights
Harmed
Children
Failure modes
Content moderation failure
Consequences
Litigation
AI systems
Character.AI chatbot
Regulations
EU AI Act (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Maldita.es - Periodismo para que no te la cuelen
Parecen humanos pero no lo son: cómo algunos chatbots de IA pueden confundir a sus usuarios (en especial a menores), condicionar sus relaciones y agravar la soledad·Maldita.es - Periodismo para que no te la cuelen
4 December 2024
infobae
Las amistades con la inteligencia artificial pretenden curar la soledad: algunas terminan en suicidio
6 December 2024