AI-generated videos of violence and misinformation spread on Spanish social media
Videos created with Sora 2 and other AI tools showing fake violence, including depictions of women being strangled, have spread on TikTok and X in Spain. The content violates platform policies and raises concerns about the misuse of hyperrealistic video generation technology to create misleading and harmful material.
What happened
Sora 2, OpenAI's AI video generation tool, has been used to create fake videos depicting violence, including depictions of women being strangled by other women.
These videos were published on TikTok and X with sensationalist titles, some bearing Sora 2's watermark, violating the platforms' terms of use policies.
Reported impact
The spread of AI-generated violent content raises concerns about potential harm and the misuse of hyperrealistic video generation technology.
The videos create misleading material that can feed into violence and undermine trust in visual media.
Index analysis
Sora 2 was presented by OpenAI in late September and gained significant popularity within days. The tool's capability to generate hyperrealistic videos from text has enabled both legitimate use and creation of deceptive content that violates platform policies.
Governance controls
TikTok has begun removing content inciting hate and violence. X has declined to remove accounts distributing the videos.
Pressure is increasing on OpenAI to implement barriers to prevent misuse of the video generation tool.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.