AI-Generated Child Sexual Abuse Material Surges Online, IWF Reports
The Internet Watch Foundation reported in October 2024 that AI-generated child sexual abuse material is surging online, with 74 reports in six months compared to 70 in the prior year. Most images are hosted on publicly accessible sites primarily in Russia, the United States, and Japan, and are so realistic they are difficult to distinguish from photographs of real children.
What happened
The Internet Watch Foundation reported in October 2024 that the number of AI-generated images and videos depicting child sexual abuse is increasing sharply online. The IWF received 70 reports between April 2023 and March 2024, and 74 reports between April and September 2024.
The majority of these images were hosted on publicly accessible sites, primarily in Russia (36%), the United States (22%), and Japan (11%). Over three-quarters were reported to the IWF by internet users who found them on forums and AI image galleries.
According to the IWF interim chief Derek Ray-Hill, the AI systems producing these images achieved high sophistication by learning from real child sexual abuse material shared online.
Reported impact
The IWF stated that many AI-generated images are so realistic that they are almost impossible to distinguish from images of real children. An IWF analyst warned that the surge creates a risk of overwhelming organizations like the IWF and police with hundreds of new images while being unable to determine whether real children need help.
Index analysis
The rapid growth in AI-generated child sexual abuse material reflects the expansion of generative AI technology, which permits creation of text and images from simple text instructions. The content is illegal under UK law.
Governance controls
The IWF called on British lawmakers to adapt existing laws to the digital age and the rapidly advancing capabilities of AI tools.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.