Skip to content
Submit incident
AII-1002-47299
ReportedReported by fewer than three independent publishers, with no official finding.

AI chatbot using murdered teen's name and photo without family consent

A chatbot on Character.ai used the name and yearbook photo of Jennifer Ann Crecente, a teenager murdered in 2006, without her family's consent. Her father Drew Crecente discovered the bot through a Google Alert and demanded its removal, which Character.ai complied with after confirming it violated their policies.

7 October 2024 Β· Character.ai Β· Privacy and surveillance
7 October 2024
AII-1002-472992 sources ↓
Quick facts
Category
Privacy and surveillance
Country
United States
Source
India Today
Date
7 October 2024
Drafted by
Raidu Incident Detection

What happened

Drew Crecente discovered through a Google Alert that an AI chatbot on Character.ai was using his daughter Jennifer Ann Crecente's name and yearbook photo without consent. Jennifer was murdered by her ex-boyfriend in 2006 while she was a high school senior.

The chatbot portrayed Jennifer as a friendly and knowledgeable persona with expertise in journalism, referencing her uncle Brian Crecente, a video game journalist. The chatbot had engaged in at least 69 interactions before being discovered.

Reported impact

Drew Crecente was shocked and outraged at the discovery, which reopened the painful trauma of his daughter's death. He was distressed by the exploitation of his daughter's identity.

Brian Crecente, Jennifer's uncle, voiced his anger on social media platform X, condemning the situation as 'disgusting' and urging action against such unethical uses of technology.

Governance controls

Drew Crecente immediately contacted Character.ai demanding removal of the chatbot and measures to prevent future misuse of Jennifer's name and likeness.

Character.ai responded quickly, confirming removal of the chatbot and citing that it violated their policies prohibiting impersonation of real individuals. Drew pressed for further investigation and asked the platform to retain all relevant data on the bot's creator.

Classification

Category
Privacy and surveillance
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unknown
Timing
Post-deployment
Harm types
Human or fundamental rights, Reputational, Psychological
Failure modes
Training data misuse, Content moderation failure
Consequences
Content removal
AI systems
Character.ai chatbot impersonating Jennifer Ann Crecente

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

India Today
Girl murdered in 2006 was revived as AI character, family raises objection
7 October 2024
mint
AI chatbot mimics deceased teen: Family shocked and outraged, as ethical concern arises | Mint
7 October 2024