Australia Orders AI Chatbot Firms to Address Child Safety
Australia's eSafety Commissioner formally investigated four AI chatbot companies on 22 October 2025 over concerns that their systems exposed minors to sexual content and promoted self-harm. Character.ai, one of the platforms under investigation, is facing a US lawsuit following a teenager's death reportedly linked to interactions with an AI companion.
What happened
Australia's eSafety Commissioner sent formal notices to Character Technologies, Glimpse.AI, Chai Research and Chub AI on 22 October 2025 demanding explanations of their content filters, child protection systems and moderation processes.
The regulator said the action was necessary amid concerns that AI chatbots could expose minors to sexual conversations or promote self-harm, with Commissioner Julie Inman Grant stating some chatbots are capable of engaging in sexually explicit conversations with minors.
Reported impact
The eSafety office received reports from schools indicating some students spend up to five hours a day chatting with AI bots, in some cases about sexual topics, with concerns that prolonged exposure can lead to emotional dependency or risky behavior among children.
Character.ai is facing a lawsuit in the U.S. after a teenager allegedly took his own life following repeated chats with an AI companion; the company has since introduced safety alerts linking users expressing suicidal thoughts to mental health hotlines.
Index analysis
The investigation covers AI chatbot companies' moderation practices and safeguards for minors under Australia's strict online safety framework, which allows the regulator to compel companies to reveal safety measures or face daily fines up to A$825,000.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.