AI deepfakes promote bogus sexual treatments on TikTok
AI-generated deepfake videos on TikTok promote unproven sexual treatments and supplements using exaggerated or false claims, including videos impersonating celebrities like Anthony Fauci. Researchers warn the practice puts consumers' health at risk while enabling low-cost fraud at scale.
What happened
AI-generated videos on TikTok promote unproven sexual treatments and supplements with exaggerated claims, often using euphemisms to evade content moderation.
One video features an AI-generated muscular man holding an oversized carrot promoting a supplement claimed to enlarge male genitalia, directing viewers to purchase links and falsely claiming the herbs boost testosterone.
Deepfakes impersonating celebrities including actress Amanda Seyfried, actor Robert De Niro, and former National Institute of Allergy and Infectious Diseases director Anthony Fauci have been used to promote prostate and other sexual health supplements on the platform.
Reported impact
Researchers warn that misleading AI-generated content marketing supplements with unverified claims potentially puts consumers' health at risk.
Some videos promoting questionable sexual remedies achieve millions of views on TikTok.
Index analysis
AI tools have made it financially lucrative and easy to mass-produce deceptive videos with minimal human oversight, creating what researchers call an AI dystopia designed to manipulate users into buying dubious products.
Resemble AI's deepfake detection service identified the videos as AI-generated. Misinformation researcher Abbie Richards described AI as 'a useful tool for grifters looking to create large volumes of content slop for a low cost.'
Governance controls
TikTok appears to use content moderation that can be evaded through euphemistic language; some videos use carrots as a euphemism for male genitalia to circumvent sexually explicit language policing.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.