Skip to content
Submit incident
AII-1000-33529
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

San Francisco orders Apple and Google to remove nudification apps

The San Francisco City Attorney demanded that Apple and Google remove 13 AI 'nudification' apps from their app stores for creating non-consensual sexual deepfake images. Both companies confirmed they had taken action against the apps, with Apple removing three and planning developer account terminations, and Google stating it had deleted hundreds of such apps.

17 July 2026 Β· Apple Β· Harmful and abusive content
17 July 2026
AII-1000-335296 sources ↓
Quick facts
Category
Harmful and abusive content
Country
United States
Source
Ars Technica
Date
17 July 2026
Drafted by
Raidu Incident Detection

What happened

The San Francisco City Attorney sent cease-and-desist letters to Apple and Google on July 17, 2026, demanding removal of 13 AI 'nudification' or 'face-swap' appsβ€”eight from the App Store and five from the Play Storeβ€”that create non-consensual nude images by digitally undressing people in photos or videos.

The attorney's office argued that Apple and Google were 'aiding and abetting' the sale of explicit deepfake images by profiting from in-app payments and collecting millions in fees from the apps, despite having developer policies against pornography.

Reported impact

The nudification apps enabled creation of non-consensual sexual deepfakes and nude images, which is illegal, and have led to production of child sexual abuse material (CSAM) in at least one case involving five anonymous young women and girls.

Some of those affected feared that AI deepfakes shared online could lead to offline stalking by sex predators.

Index analysis

Both Apple and Google had previously removed batches of nudify apps after being flagged by researchers, and Apple had tightened App Store guidelines on developer responsibility for pornographic content in June 2026.

In response to the cease-and-desist letters, Apple stated it had removed three of the named apps and was terminating their developer accounts, while also reviewing four others for policy violations. Google confirmed deletion of 'hundreds' of apps with nudifying features for policy violations, including the five named in the letters.

Governance controls

Both Apple and Google maintain developer rules prohibiting pornography and apps designed to generate, distribute, or consume pornography.

Apple stated the App Store was designed to be a safe and trusted place and users can report illegal or abusive content via reportaproblem.apple.com.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Human or fundamental rights, Psychological
Harmed
General public, Women
Failure modes
Deepfake image
Consequences
Content removal
AI systems
AI nudification apps

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Ars Technica
Apple, Google must stop profiting off AI nudify apps, San Francisco AG says
17 July 2026
TechCrunch
Apple and Google ordered to purge 'nudify' apps from App Stores
17 July 2026
thehindu.com
San Francisco orders Apple and Google to remove nudification apps
9to5Mac
Apple ordered to remove 8 "nudify" apps from the App Store
17 July 2026
engadget
Apple and Google ordered by San Francisco attorney to take action against 'nudify' apps - Engadget
17 July 2026
MacRumors
Apple and Google Hit With Demand to Pull AI 'Nudify' Apps
17 July 2026