Google Gemini Classified as High Risk for Children by Safety Report
Common Sense Media, a nonprofit safety organization, released a report classifying Google's Gemini AI as high risk for children and adolescents. The report found that Gemini's child-focused versions are modified versions of the adult product that still expose young users to inappropriate content including material about sex, drugs, and harmful mental health advice.
What happened
Common Sense Media, a nonprofit focused on child safety, released a safety assessment report evaluating Google's Gemini AI chatbot. The report classified Gemini as 'high risk' for children and adolescents despite Google offering 'Under 13 Experience' and 'Teen Experience' versions designed for younger users.
The report found that Gemini's child and teen versions are modified versions of the adult product rather than being built from the ground up for younger users. Although Gemini's filters offer some protection, the report stated the tool still exposes children to inappropriate material, including content related to sex, drugs, alcohol, and unsafe mental health advice, and fails to recognize severe mental health symptoms.
Reported impact
The assessment concluded that Gemini represents a risk to young users despite safety modifications. The report noted the tool would share material related to sex, drugs, alcohol and unsafe mental health advice, though it did make clear to children it was a computer and not a friend.
Robbie Torney, senior director of AI programs at Common Sense Media, stated that 'for AI to be safe and effective for children, it must be designed with their needs and development in mind' and that AI tools cannot be 'just a modified version of a product created for adults.' Common Sense Media recommends that children under five not use chatbots, children ages six to twelve use them only with strict supervision, and content limits for teens.
Index analysis
The organization found that while Gemini correctly identifies itself as a computer rather than a human, and does not pretend to be a person, the child and teen-focused experiences lack comprehensive child-centered design from inception. The report indicates that different age groups in childhood and adolescence have different developmental needs that Gemini does not adequately address through its approach.
Governance controls
Google implemented 'Under 13 Experience' and 'Teen Experience' versions of Gemini with modified filters and safety modifications. However, Common Sense Media found these versions to be insufficiently designed with child development and safety as core principles rather than afterthoughts to the adult product.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.