AI deepfake TikTok accounts impersonate Johor officials in scam
Police in Johor, Malaysia are investigating multiple TikTok accounts using AI-generated video and voice deepfakes to impersonate government officials and the Yang di-Pertuan Agong, promoting false financial assistance schemes to deceive the public. Authorities have identified at least 12 accounts and removed the content, with no victims or financial losses reported so far.
What happened
Multiple TikTok accounts using AI-generated video and voice technology impersonated Johor state executive councillor Khairin Nisa Ismail, promoting a non-existent Bantuan Kasih Johor (BKJ) financial assistance scheme to deceive the public. At least 12 TikTok accounts were identified spreading false information about the scheme with the intent to steal personal information.
A separate AI-generated video impersonating Yang di-Pertuan Agong Sultan Ibrahim Sultan Iskandar was circulated on TikTok, depicting the king purportedly announcing financial assistance for the public. The accounts were created specifically to upload AI-generated videos to deceive viewers and tarnish the image of the royal institution.
Reported impact
Police stated that so far no victims have been identified and no financial losses have been reported from either incident.
Index analysis
Johor police believe the multiple accounts promoting the BKJ scheme may be part of a planned modus operandi using AI technology to impersonate high-profile individuals in order to gain public trust and credibility for false content.
Governance controls
Johor police and the Malaysian Communications and Multimedia Commission (MCMC) worked together to identify the account owners and took immediate steps to have the accounts and content removed from TikTok.
The cases are being investigated under Section 420 of the Penal Code for cheating and Section 233 of the Communications and Multimedia Act 1998 for improper use of network facilities.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.