Global surge in AI deepfakes fuels harassment, scams, and disinformation
Advanced AI video generation tools are enabling increasingly sophisticated deepfakes used for satire, fraud, and disinformation. Experts warn that as these tools become faster and more realistic, distinguishing synthetic content from genuine material will become harder, posing risks to public trust and security.
What happened
South Park's 27th season featured a deepfake of Donald Trump that resulted in an official statement from the White House.
Tech influencer Varun Mayya warned that as AI technology advances, deepfakes are becoming more sophisticated and realistic, making them harder to distinguish from genuine content.
Scammers have used AI-generated videos to impersonate public figures and promote fraudulent investment schemes.
Reported impact
Deepfakes are now part of the news cycle and contribute to post-truth reality where fact and fiction are indistinguishable.
The increasing realism and speed of AI-generated content poses risks to personal security and public trust, with concerns about deepfakes being used for harassment and disinformation.
Some experts predict 90% of online content could be AI-generated by 2027.
Index analysis
Deepfakes have evolved from nonconsensual pornography in 2017 to tools used for political purposes, satire, and fraud.
Advanced AI models like Wan 2.2 enable unprecedented realism and control in video generation, reducing the barriers to creating convincing fake content.
Governance controls
Corporations have mounted detection programs, though with limited success.
Philosophers and pundits have raised concerns about deepfakes as an epistemic threat, and there are calls for stricter regulations and transparency in AI-generated videos.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.