AI-powered stuffed animals raise child development and privacy concerns
Curio and other companies are selling AI-powered talking stuffed animals designed for children, but experts warn about potential replacement of parental interaction and concerns about child development. Privacy policies reveal that third-party providers including Microsoft and OpenAI may collect children's personal information, conflicting with the company's public claims about data retention.
What happened
Curio, a Silicon Valley startup, has released AI-powered talking stuffed animals named Grem and Grok designed to provide screen-free play for children. The toys are equipped with chatbot technology and microphones, trained using OpenAI's API and interactive Discord conversations.
Curio's privacy policy states that Microsoft's Azure Cognitive Services, OpenAI, Perplexity AI, and Kids Web Services may 'collect or maintain personal information from children through the App or Device.' This conflicts with the company's public claim that it does not retain children's interactions except for parental review in the app.
Reported impact
Critics and experts worry the toys may replace parental interaction and emotional bonding. New York Times writer Amanda Hess described the experience with Grem as 'more of a substitute for her own presence' than a toy upgrade.
Concerns have been raised that the toys encourage children to view technology as the ultimate source of answers and curiosity rather than developing independent thinking or relying on human relationships.
Index analysis
Curio's privacy policy reveals that multiple third-party providersโincluding Microsoft, OpenAI, and Perplexity AIโmay collect or retain personal information from children, despite the company's public reassurances about data handling.
Other AI-powered stuffed animals sold by lesser-known companies such as Little Learners and FoloToy reportedly have even vaguer privacy protections and questionable online practices.
Governance controls
Curio states that it does not retain children's interactions except for parental review in the toy's accompanying app, but this claim is contradicted by language in its privacy policy regarding third-party data collection.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.