Skip to content
Submit incident
AII-1002-52039
ReportedReported by fewer than three independent publishers, with no official finding.

AI-generated influencers exploit stolen images on Instagram

Hundreds of AI-generated influencer accounts on Instagram reportedly steal videos and images from real models and adult content creators, apply AI-generated faces, and monetize the content. Investigations documented over 1,000 such accounts using off-the-shelf AI tools, with real creators reporting significant declines in reach and income as they compete against the synthetic content.

17 November 2024 · Meta/Instagram · Intellectual property and appropriation
17 November 2024
AII-1002-52039View source ↗
Quick facts
Category
Intellectual property and appropriation
Country
United States
Source
Wired
Date
17 November 2024
Drafted by
Raidu Incident Detection

What happened

Hundreds of AI-generated influencer accounts on Instagram steal videos from real models and adult content creators, apply AI-generated faces to their bodies, and monetize the content with links to dating sites, Patreon, OnlyFans competitors, and AI apps.

An investigation reviewed more than 1,000 AI-generated Instagram accounts and Discord channels where creators share tips on "AI pimping." The practice uses off-the-shelf AI tools, some available on the Apple App Store and Google Play Store.

Reported impact

Adult content creator Elaina St James reported her Instagram reach decreased from 1-5 million views per month to under 1 million in the last 10 months, sometimes dropping below 500,000 views, after the explosion of AI-generated influencer accounts using stolen content.

Real creators report they are now directly competing with AI-generated accounts using their stolen photographs and videos, impacting their ability to make a living.

Index analysis

The practice has industrialized in scale from a niche problem first reported in April, demonstrating that Instagram appears unable or unwilling to prevent the flood of AI-generated content and protect human creators on the platform.

Researchers compiled lists of approximately 900 such accounts, though investigators noted they could have easily found 900 more if not for Instagram's account scraping restrictions.

Governance controls

No governance measures by Instagram to address the issue are documented in the reporting.

Classification

Category
Intellectual property and appropriation
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Intentional
Timing
Unknown
Harm types
Economic or property, Reputational
Harmed
Workers, Consumers
Failure modes
Deepfake image, Deepfake video, Model theft
AI systems
Off-the-shelf AI face-generation tools

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

Wired
Inside the Booming 'AI Pimping' Industry
20 November 2024