AI-generated child sexual abuse material circulated online
AI technology is being used to transform ordinary images of children shared on social media into child sexual abuse material for distribution on the darknet, according to German police. The Bundeskriminalamt reported receiving over 200,000 such tips in the previous year, with overall volumes increasing.
What happened
Seemingly harmless images of children shared online are being transformed using artificial intelligence into images depicting lightly clothed or naked children. These AI-manipulated materials are then distributed, sexualized, or placed in sexual contexts by child predators in the darknet.
Reported impact
The Bundeskriminalamt (BKA) received more than 200,000 reports of child sexual abuse material in the previous year, including such AI-altered images. The German federal government stated that such material is in circulation and that the volume of such material is generally increasing.
Index analysis
The BKA recommends that child images not be shared on the internet. The concern is that seemingly innocuous photos shared on social media by parents can be weaponized through AI technology and exploited by criminals.
Governance controls
The BKA, as the central police authority, is responsible for combating sexual abuse of children and issued guidance advising against sharing child images online. The German federal government acknowledged the problem and stated measures are in place to make it difficult for pedophiles while making it harder for offenders.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.