Meta warns of AI-powered romantic scams
Meta warned that scammers increasingly use AI tools including deepfakes and voice cloning to impersonate romantic interests and manipulate people seeking relationships online into sending money. A Cambodia-based cybercriminal group reportedly used OpenAI software to target Japanese and Mandarin Chinese speakers.
What happened
Meta warned internet users of increasing risk of AI being used by scammers targeting people seeking romantic relationships online. AI tools allow scammers to create images, videos with fake voices, respond to video calls, and impersonate people.
A cybercriminal group based in Cambodia targeted Japanese and Mandarin Chinese speakers using OpenAI software to create and translate content. According to OpenAI researchers, scammers spend time building trust relationships with victims before gradually extracting money or personal data.
Reported impact
Scammers target people seeking romance online to extract money or personal data. Meta stated it can only detect part of their activity across all social media platforms.
Index analysis
Generative AI has been widely available for about one year, but its use in scams has increased in recent months as freely available tools enable scammers to create convincing fake personas. Scammers can use AI bots to make calls with fake voices without human intervention.
Governance controls
Meta executive Rachel Tomback urged users to be 'kindly paranoid' when meeting someone online and developing feelings, especially if the person requests money for an alleged emergency or business opportunity. Meta highlighted that loneliness, seasonal depression, and Valentine's Day are circumstances exploited by scammers.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.