Skip to content
Submit incident
AII-1002-52091
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.Supporting sources are pending verification.

AI-generated child sexual abuse material recognized as emerging threat in Italy

Telefono Azzurro, Italy's child emergency service, reported that synthetic child sexual abuse material (CSAM) generated by AI is an emerging threat to children. The foundation's 2024 dossier noted that such material makes it harder to distinguish real from fabricated content, and called for immediate intervention to combat the phenomenon.

18 November 2024 Β· Dipartimento per le Politiche della Famiglia Β· Harmful and abusive content
18 November 2024
AII-1002-52091
Quick facts
Category
Harmful and abusive content
Country
Italy
Date
18 November 2024
Drafted by
Raidu Incident Detection

What happened

The Dossier Abuso 2024 from Fondazione S.O.S Telefono Azzurro highlighted the growing spread of synthetic child sexual abuse material generated by artificial intelligence.

Ernesto Caffo, president of Telefono Azzurro, stated that this new threat makes it harder to distinguish the real from the virtual, and called for immediate intervention to counter the phenomenon.

Reported impact

The report raised concerns that AI-generated synthetic CSAM obscures the distinction between real and fabricated content, complicating efforts to protect children.

Governance controls

The Dossier Abuso 2024, presented at Palazzo Chigi on 18 November during the International Day for the Protection of Children Against Sexual Abuse and Exploitation, called for coordinated national and international responses to address synthetic CSAM and other emerging forms of online child sexual exploitation.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Italy
Harm status
Potential harm
Intent
Unknown
Timing
Unknown
Harm types
Human or fundamental rights, Psychological
Harmed
Children
Failure modes
Deepfake image
AI systems
Generative AI systems

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident