Skip to content
Submit incident
AII-1001-95709
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Judge Orders Blocking of Website Generating AI Fake Intimate Images of Adolescents

An Argentine court ordered the blocking of a website that used AI to generate fake intimate images of adolescents without their consent. Judge Marta Rut Legarreta issued the order after a parent complained that the tool had been used to create false sexually explicit images of his daughter, which were distributed via WhatsApp.

22 May 2025 · Ente Nacional de Comunicaciones · Harmful and abusive content
22 May 2025
AII-1001-957092 sources ↓
Quick facts
Category
Harmful and abusive content
Country
Argentina
Source
Cadena 3 Argentina
Date
22 May 2025
Drafted by
Raidu Incident Detection

What happened

A website using advanced AI models generated fake intimate images by placing faces of real adolescent girls on other bodies in sexual poses or digitally removing their clothing, without consent. The tool was distributed through WhatsApp.

Judge Marta Rut Legarreta of the Family, Childhood and Adolescence Court of Paso de los Libres ordered the immediate blocking of the website following a complaint from a parent of one of the affected adolescents who provided the name of the program used.

Reported impact

The judge found that concrete harm occurred through the application's operation, which allowed creation and sharing of simulated sexual content without verifying age or consent. The digital environment lacks effective age and consent barriers, exposing children and adolescents to modern forms of symbolic, digital, and psychological violence.

Index analysis

The judge based the decision on international treaties and national laws protecting children and preventing gender violence, including Law Olimpia (N°27.736) recognizing digital violence as a form of aggression against women. The judge emphasized concrete risks posed by the digital environment when preventive filters do not exist, especially for girls and adolescents.

Governance controls

The judge ordered Enacom to immediately block access to the website and its DNS servers from Argentina and instructed the Specialized Fiscal Unit for Cybercrime (Ufeci) to collaborate in investigations and identify those responsible. The protective measure will remain in effect until the risk of harm ceases, prioritizing the superior interest of affected adolescents.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Argentina
Harm status
Actual harm
Intent
Intentional
Timing
Post-deployment
Harm types
Psychological, Human or fundamental rights
Harmed
Children
Failure modes
Deepfake image
Consequences
System suspension or termination
AI systems
AI-powered deepfake intimate image generator
Regulations
EU AI Act (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Cadena 3 Argentina
Bloquean un sitio en Corrientes por generar imágenes íntimas falsas con IA de adolescentes
22 May 2025
La Nacion
La Justicia ordenó al Enacom el bloqueo de un sitio web que usa Inteligencia Artificial para crear imágenes íntimas falsas
22 May 2025