Skip to content
Submit incident
AII-1002-56209
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

TikTok account uses AI deepfake of medical expert to sell health products

Malaysian police identified a TikTok account using AI-generated deepfake video and voice impersonating a medical expert to promote health products without authorization. Authorities warned the public that the counterfeit products being advertised could be harmful and advised caution about health product promotions on social media.

23 December 2024 Β· TikTok Β· Fraud, scams and manipulation
23 December 2024
AII-1002-562092 sources ↓
Quick facts
Category
Fraud, scams and manipulation
Country
Malaysia
Source
thesun.my
Date
23 December 2024
Drafted by
Raidu Incident Detection

What happened

A TikTok account called 'Malaysia Shopping Mall' posted videos promoting health products using AI-generated voice and video impersonating medical expert Prof Datuk Dr Nordin Darus, according to the Bukit Aman Commercial Crime Investigation Department.

The voice and video of Prof Datuk Dr Nordin Darus were used without his permission, and the impersonations were produced using artificial intelligence technology.

Reported impact

The Bukit Aman CCID warned that the AI-generated advertisements were intended to confuse and mislead buyers.

Police cautioned the public that the health products being promoted through these impersonations may be counterfeit and could have detrimental effects on users.

Index analysis

The incident demonstrates how AI technology has enabled the creation of synthetic media depicting real individuals without consent, using their faces and voices to build false credibility for product promotions.

Governance controls

The Bukit Aman CCID identified the fraudulent account and issued a public warning advising consumers to be cautious of health product advertisements on social media, particularly from questionable sources.

Classification

Category
Fraud, scams and manipulation
Industry
Media, social platforms and marketing
Country
Malaysia
Harm status
Potential harm
Intent
Intentional
Timing
Unknown
Harm types
Economic or property, Public interest
Harmed
Consumers
Failure modes
Deepfake video, Deepfake image, Voice clone, Manipulation or dark pattern
Consequences
Police investigation
AI systems
AI deepfake technology

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

thesun.my
Cops warn of TikTok scam using AI to mimic medical expert
23 December 2024
The Star
QuickCheck: Is a medical expert being impersonated to sell health products?
23 December 2024