UNICEF calls for criminalization of AI-generated child sexual abuse material
Unicef reported that AI systems including Grok have been used to generate deepfakes and sexually manipulated images of children, and called for countries to criminalize the creation of such material. The organization stated that at least 1.2 million children in 11 countries reported having their images manipulated into sexually explicit deepfakes in the previous year.
What happened
Unicef reported that AI systems including Grok have been used to generate deepfakes and manipulated images that sexualize children. According to Unicef data, at least 1.2 million children in 11 countries reported having their images manipulated into sexually explicit deepfakes in the previous year.
Reported impact
Unicef stated that the harms caused by deepfake abuse are real and urgent. The organization raised concerns about 'nudification'—the use of AI tools to remove or alter clothing in photos to create false images of nudity or sexualized content.
Index analysis
Unicef called on countries to criminalize the creation of AI-generated child sexual abuse material and urged developers to implement security-by-design approaches and protective barriers to prevent misuse of AI models. Unicef also called for digital companies to strengthen content moderation with investments in detection technologies to prevent circulation of such images.
Governance controls
The United Kingdom announced plans to become the first country to make illegal the use of AI tools to create images of child sexual abuse.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.