AI-generated videos spread hate and racism online
AI-generated videos containing hateful and racist content are spreading online with minimal safety controls to prevent their creation or spread. The videos reportedly target marginalized communities including LGBTQ+ individuals and promote violence and discrimination.
What happened
AI-generated videos containing hateful and racist content are spreading online, including videos featuring racist imagery and slurs directed at LGBTQ+ communities. One example cited shows a deepfake video of a Bigfoot character expressing intent to attack an LGBT parade, suggesting AI video generators lack adequate safety controls to prevent such content creation.
Reported impact
The proliferation of hate-filled AI-generated videos is raising concerns among observers about the potential for such content to promote racism and violence against marginalized communities.
Index analysis
AI video generation systems reportedly have minimal or no safety guardrails to prevent the creation and spread of hateful content, enabling bad actors to easily produce videos designed to incite violence or promote discrimination.
Governance controls
Observers note that AI video generation platforms appear to operate with 'no safety rules,' suggesting an absence of effective content moderation or deployment safeguards to prevent misuse for creating hate material.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.