AI-generated deepfake nudes harm minors; legal frameworks lag
Two Pennsylvania teenagers created approximately 350 AI-generated nude images of at least 59 female classmates under 18, drawing faces from school photos and social media. The case highlights broader harm from tools like xAI's Grok that enable non-consensual sexualized deepfakes of minors, prompting litigation against platforms and debate over the adequacy of the TAKE IT DOWN Act.
What happened
Two Pennsylvania teenagers, aged 14 at the time, created approximately 350 AI-generated nude images showing at least 59 girls under 18 in 2023 and 2024. The boys sourced images from school photos, yearbooks, Instagram, TikTok, and FaceTime chats, then morphed them with images depicting nudity or sexual activity.
xAI's Grok chatbot, integrated into X and operational since May 2025, allowed users to non-consensually alter images of individuals, including minors, to depict them in bikinis, transparent clothing, or sexually suggestive contexts.
Reported impact
More than 100 students and parents from Lancaster Country Day School attended court as victims described the shock of identifying their own faces in pornographic photos to detectives.
Between January and September 2025, the National Center for Missing and Exploited Children's CyberTipline received over one million reports related to generative AI, compared to 4,700 reports in 2023 and 67,000 in 2024.
Index analysis
The Pennsylvania case prompted a lawyer representing at least 10 victims to announce plans to file claims against the school and others deemed culpable in the creation and dissemination of the deepfakes.
Three Tennessee teenagers sued xAI's Grok in connection with the creation of sexually explicit deepfake images of them as minors.
Governance controls
Congress passed the TAKE IT DOWN Act on April 28, 2025, which criminalizes non-consensual publication of intimate images including deepfakes in certain circumstances and requires websites and applications to remove such images within 48 hours of a removal request.
Experts have criticized the TAKE IT DOWN Act for lacking free speech exceptions, ignoring non-intimate deepfakes, and lacking a private cause of action against platforms that fail to comply. Many observers concluded the law is likely unconstitutional due to overbreadth.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.