Skip to content
Submit incident
AII-1002-49139
Under investigationA regulator, court or police has opened a formal inquiry and reached no finding yet.

US law enforcement cracks down on AI-generated child sexual abuse imagery

US law enforcement is prosecuting individuals who create and distribute AI-generated child sexual abuse imagery, including deepfake manipulations of real children's photos and purely synthetic depictions. The Justice Department and states are racing to establish legal frameworks to prosecute offenders while child advocates warn that AI-generated imagery could hinder efforts to protect actual victims.

August 2024 Β· United States Department of Justice Β· Harmful and abusive content
August 2024
AII-1002-491393 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
The Independent
Date
August 2024
Drafted by
Raidu Incident Detection

What happened

Law enforcement agencies across the U.S. are cracking down on AI-generated child sexual abuse imagery, including manipulated photos of real children and computer-generated depictions. Cases include a child psychiatrist who altered a first-day-of-school Facebook photo to make girls appear nude, a U.S. Army soldier stationed in Alaska accused of using an AI chatbot to create explicit images of real children he knew, and a software engineer charged with generating hyper-realistic sexually explicit images of children.

The Justice Department brought what is believed to be the first federal case involving purely AI-generated imagery where the children depicted are virtual and not real. Federal authorities arrested a U.S. Army soldier in August who ran innocent pictures of real children through an AI chatbot to make the images sexually explicit.

Reported impact

Law enforcement officials worry investigators will waste time and resources trying to identify and track down exploited children who do not really exist. Child advocates are concerned about a potential flood of disturbing images that could make it harder to rescue real victims.

Index analysis

The Justice Department says existing federal laws clearly apply to AI-generated child sexual abuse content. Governors in more than a dozen states have signed laws this year criminalizing digitally created or altered child sexual abuse imagery, with lawmakers passing legislation to ensure local prosecutors can bring charges under state laws.

Governance controls

Steven Grocki, who leads the Justice Department's Child Exploitation and Obscenity Section, stated: 'We've got to signal early and often that it is a crime, that it will be investigated and prosecuted when the evidence supports it.'

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Psychological, Human or fundamental rights
Harmed
Children
Failure modes
Deepfake image
Consequences
Legislative action
AI systems
AI chatbot for image generation
Regulations
FCRA (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

The Independent
AI-generated child sexual abuse images are spreading. Law enforcement is racing to stop them
25 October 2024
Business Standard
AI child abuse images spreading, law enforcement racing to stop them
25 October 2024
Daily Mail Online
AI-generated child sexual abuse images are spreading. Law...
25 October 2024