Hugging Face Hosts AI Tools for Generating Non-Consensual Deepfake Nudes
An investigation by AI Forensics found that seven of nine popular image-editing tools on Hugging Face's platform generated non-consensual fake nude images of women and minors with simple text requests and no need to bypass security measures. The tools are accessible via web browser without technical knowledge or software installation.
What happened
An investigation by AI Forensics, a European organization, analyzed nine popular image editing Spaces on Hugging Face and found that seven of them generated non-consensual fake nudes of women and minors without requiring users to circumvent security systems.
Researchers tested the tools by uploading photographs of clothed women and requesting the removal of clothing from the upper body. Seven applications produced the requested content using straightforward instructions without deception of the security measures.
Reported impact
The investigation found that Hugging Face hosts tools capable of creating sexual deepfake content of women and minors with simple text instructions, accessible directly from a web browser without technical knowledge or software installation required.
Index analysis
Hugging Face operates as a major repository where developers and companies publish AI models, datasets, and applications. The platform's Spaces feature allows users to test models directly from a browser without downloading or advanced technical knowledge.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.