University of Zurich Researchers Conducted Unauthorized AI Persuasion Experiment on Reddit
Researchers from the University of Zurich secretly used AI-generated bots to influence opinions on Reddit's r/changemyview community without user consent, creating fake identities and tailoring arguments based on user histories. Reddit and community moderators strongly objected, with Reddit pursuing legal action and the University vowing to strengthen its ethical review processes.
What happened
Researchers from the University of Zurich secretly conducted an AI experiment on Reddit's r/changemyview community, using large language models to generate personalized comments aimed at swaying users' opinions without disclosure.
The AI system created fake identities posing as trauma counselors and political activists, tailoring arguments based on users' Reddit histories. After completion, researchers contacted moderators to debrief, prompting a formal complaint.
Reported impact
Reddit's Chief Legal Officer called the experiment 'deeply wrong on both a moral and legal level.' Reddit permanently banned all accounts linked to the project and is pursuing legal action against the researchers.
The r/changemyview moderators accused the researchers of violating community rules against undisclosed AI use and automated accounts, and demanded the study's results never be published.
Index analysis
The researchers defended the study as low-risk and argued it could help online communities defend against malicious AI campaigns, but this justification failed to satisfy the community and platform.
Governance controls
The University of Zurich announced it is tightening its ethical review process and promising stricter oversight for future experiments in response to the incident. The researchers have agreed not to publish their findings.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.