AI-generated fake images and video cause disorder in China
Two Weihai residents were administratively punished by Chinese cybersecurity authorities for using AI tools to create and spread false content online—one fabricated a prisoner livestreaming sales, the other a typhoon-damaged school building—causing public disorder and panic.
What happened
Two Weihai residents used AI tools to create and spread false content online. Zhang Mou created an AI-generated image depicting a prisoner livestreaming sales of goods and posted it to an internet platform to gain followers and traffic. Chi Mou used AI to fabricate a video showing two teaching buildings in Yangjiang, Guangdong damaged by typhoon and posted it to a short video platform during Typhoon season in Guangdong.
Reported impact
Zhang Mou's post attracted widespread attention and discussion from netizens and disrupted public order. Chi Mou's false disaster video misled large numbers of netizens, seriously disrupted social public order, triggered panic, and caused adverse social impact.
Index analysis
AI-generated misinformation has established a grey industry chain with clear division of labor. AI can generate between 4,000 to 7,000 false articles per day at one percent the cost of traditional rumor-making. Compared to traditional rumors, AI rumors have exponentially amplified harm due to their technical characteristics and high fidelity, making them difficult for ordinary netizens to distinguish. AI rumors possess strong evolution and iteration capability, rapidly generating new versions to counter debunking information.
Governance controls
Public security authorities issued administrative penalties to Zhang Mou and Chi Mou under Article 25 of the Law of the People's Republic of China on Public Security Administration Penalties, which provides for detention of 5 to 10 days plus potential fines up to 500 yuan for spreading rumors and disturbing public order; lesser offenses receive up to 5 days detention or fines up to 500 yuan.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.