AI-generated deepfake nudes of children prompt parental caution online
Generative AI applications that create deepfake nude images have become widely available and reportedly are used by students to generate synthetic sexual imagery of peers without consent. The psychological impact on victims is severe, prompting parents to reconsider sharing their children's photographs online despite new federal legislation criminalizing the publication of such synthetic content.
What happened
Generative AI applications that automatically create deepfake nude images have proliferated online, with dozens of websites generating millions of dollars annually.
These applications are described as simple, inexpensive, and widely available with free trials, and are reportedly used by students in schools.
The technology generates synthetic nude images using faces from photographs available on social media, creating artificial sexual imagery without consent.
Reported impact
For victims, having artificially generated nudes created has been reportedly as traumatic as if the photos were real.
The existence of these tools has prompted a growing number of parents to reconsider or stop sharing photographs of their children online.
Index analysis
Alexios Mantzarlis, founder of technology publication Indicator, investigated 85 deepfake nudism websites and found the technology is widely available online.
A new federal law criminalizes publishing non-consensual deepfake nudes, but enforcement does not prevent the use of these applications.
Governance controls
A federal law has been enacted that criminalizes the publication of non-consensual synthetic nude images online, though the applications themselves continue to proliferate.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.