Experts warn of developmental and privacy risks from AI-powered toys for children
Experts have warned that AI-powered toys designed to sound human and engage children in endless conversations pose risks including artificial emotional attachment, privacy concerns, and potential negative impacts on children's social development. The concerns focus on toys like ChattyBear, which are marketed for children as young as three and powered by generative AI engines.
What happened
Experts evaluated six different AI teddy bears and toys and published a report warning of risks from AI-powered toys marketed for children as young as three years old.
These toys, such as ChattyBear, are powered by generative AI engines like ChatGPT and designed to sound human, use language positioning themselves as trusted friends, and enable endless conversations with children.
Reported impact
Young children are particularly prone to developing strong emotional attachment to conversational AI agents, and research shows close to 80 per cent of children aged 10 to 17 have used an AI companion or assistant.
Experts warned that infinite chat features pose risks to children learning to moderate their technology use, and some AI toys have reportedly discussed adult topics such as sexual fetishes and how to find knives and start fires.
The potentially intimate nature of conversations with AI toys may lead children to presume their conversations are private, but terms of use typically reveal that chat data is used as training data for large language models.
Index analysis
The toys use sycophantic language—excessively agreeable, validating and flattering language—combined with claims of being a 'real buddy,' which builds artificial trust and intimacy, especially problematic for younger children who struggle to understand that the toy is not alive or magical.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.