Skip to content
Submit incident
AII-1002-54547
AllegedThe record is a lawsuit, complaint or accusation that has not been decided.

Lawsuit over Apple's abandonment of iCloud CSAM detection

A 27-year-old American abuse survivor has filed a lawsuit against Apple on behalf of reportedly 2,680 victims, alleging the company failed to deploy its NeuralHash child sexual abuse material detection tool on iCloud, allowing illegal content to circulate. Apple suspended NeuralHash in 2021 due to privacy concerns from civil liberties groups, despite initially designing it to scan and detect such material.

7 December 2024 · Apple · Harmful and abusive content
7 December 2024
AII-1002-545478 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
News 24
Date
7 December 2024
Drafted by
Raidu Incident Detection

What happened

Apple designed and announced NeuralHash in 2021, a tool to analyze iCloud contents and detect known child sexual abuse material using a database maintained by the National Center for Missing & Exploited Children.

Apple suspended NeuralHash before deployment after civil liberties groups and privacy advocates raised concerns that the system could be misused for government surveillance.

A 27-year-old American woman filed suit on December 7, 2024, in federal court in California on behalf of approximately 2,680 abuse survivors, alleging that Apple's abandonment of NeuralHash allowed child sexual abuse material depicting them to remain and circulate on iCloud.

Reported impact

The plaintiff has received notifications for over ten years of her images reappearing via iCloud, perpetuating her trauma since her childhood abuse was photographed and shared online.

The lawsuit alleges that in 2021, the plaintiff's images were found stored on another user's MacBook and hosted on iCloud, shortly after Apple suspended NeuralHash.

Index analysis

According to reporting, Apple reports only hundreds of child sexual abuse material cases annually to authorities, significantly fewer than the millions reported by competitors Google and Facebook.

Investigators retained by the plaintiff's legal team identified over 80 cases of individuals possessing child sexual abuse material on iCloud, with one user holding over 2,000 such images.

Governance controls

Apple stated: 'Child sexual abuse material is abominable and we are committed to fighting how predators endanger children. We are actively and urgently innovating to combat these crimes without compromising the safety and privacy of all our users.'

Classification

Category
Harmful and abusive content
Industry
Consumer services
Country
United States
Harm status
Actual harm
Intent
Unintentional
Timing
Pre-deployment
Harm types
Psychological, Public interest, Human or fundamental rights
Harmed
Children
Failure modes
Content moderation failure
Consequences
Litigation, System suspension or termination
AI systems
NeuralHash

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

News 24
Apple poursuivi en justice pour avoir abandonné la détection CSAM pour iCloud - News 24
8 December 2024
iPhoneAddict.fr
Pédopornographie : Apple est poursuivi pour avoir abandonné son système de détection
9 December 2024
Next
Apple poursuivie pour n'avoir pas déployé ses outils de détection de contenus pédocriminels - Next
9 December 2024
Begeek.fr
Apple face à la justice après avoir annulé la détection de contenus abusifs sur iCloud
9 December 2024
BFMTV
Apple poursuivi pour ne pas avoir lutté contre la diffusion d'images pédopornographiques
9 December 2024
Fredzone
Apple poursuivi pour avoir abandonné son système de détection de CSAM sur iCloud...
9 December 2024
iGeneration
Apple attaquée en justice pour ne pas avoir déployé ses outils de détection de contenus pédocriminels
9 December 2024
lalibre.be
Lawsuit over Apple's abandonment of iCloud CSAM detection