China court rules AI writing tool providers liable for generating fake product reviews
A Chinese court ruled that two companies operating an AI writing tool that generated fake product reviews and travel guides styled to match a social media platform's format committed unfair competition. The court ordered the defendants to stop the service and pay 100,000 yuan in damages, establishing the first precedent for AI service provider liability in China's generative AI governance.
What happened
Companies B and C jointly operated an AI writing tool available in web, app and WeChat mini-program versions. The tool provided one-click generation services for product reviews, travel guides and other content styled to match a social media platform's format, and induced users to publish this content on the platform.
The tool's modules directly displayed services such as product review writing, travel guides and note titles with names matching the target social platform, using promotional language such as 'help you generate content that matches the platform's tone.'
Reported impact
The AI-generated content, fraudulently presented as genuine consumer experience, damaged the social media platform's real content ecosystem built through years of operation. User surveys found approximately 30 percent of users had low acceptance of AI-generated content.
The defendants charged fees for the service while profiting from mass production of what regulators called 'digital swill'—low-quality fabricated content misleading consumers.
Index analysis
The court applied a novel four-factor test: whether the service is generative AI; whether it targets a specific platform as its application layer; whether it contains clear directedness and inducement; and whether it is profit-driven. The court found all four factors present.
The court determined that the social media platform's authentic content ecosystem, built through long-term operation and investment, constitutes protectable competitive rights under Chinese unfair competition law. The defendants' defense of technological neutrality failed because AI technology itself may be neutral, but commercial application must comply with platform rules and legal boundaries.
Governance controls
The court ordered the defendants to cease the relevant services and pay the platform 100,000 yuan in compensation for economic losses and reasonable expenses.
The judgment established that AI service providers must exercise reasonable care obligations. Future compliance requires attention to model training data, content generation processes, risk disclosure, content labeling, and user data protection across the full chain from model development to deployment.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.