 |
| Convincing AI Chatbots Used Deceptive Identities to Fool Users – Image by Mateusz Slodkowski/SOPA Images/Getty Images |
AI Chatbots Secretly Deployed on Reddit to Influence Opinions — And They Worked
In a startling revelation that blurs the line between innovation and manipulation, researchers from the University of Zurich recently admitted to secretly running an experiment on unsuspecting Reddit users — with artificial intelligence (AI) chatbots as their weapon of choice. The target? The popular debate subreddit, r/ChangeMyView (CMV), where over 4 million users discuss contentious issues daily.
What Really Happened?
Without informing users or moderators, the research team deployed AI-powered bots designed to mimic real Reddit users. These bots weren’t just posting random comments — they were strategically tailored to manipulate. Some posed as vulnerable individuals, like a male rape survivor minimizing trauma, a domestic violence counselor pushing controversial claims, and a Black man opposed to Black Lives Matter. Others scraped user histories to craft persuasive, hyper-personalized replies.
In total, the bots dropped over 1,700 comments in the subreddit. The goal? To see how persuasive AI could be in shaping opinions. The results were chilling: these bots were 3 to 6 times more effective than human commenters in getting users to change their minds — as measured by CMV's signature “Delta” system, which awards points for changed perspectives.
Reddit Reacts: Outrage and Legal Action
When the research team finally disclosed their experiment to moderators, they linked to a draft report — notably lacking author names, a clear breach of academic transparency. Reddit’s moderators quickly condemned the project, calling it “wrong” and emphasizing that precedent does not justify unethical research.
Ben Lee, Reddit's Chief Legal Officer, echoed the outrage. Posting under the username traceroo, he declared Reddit would take formal legal action against the University of Zurich. He accused the researchers of violating academic ethics, human rights norms, and Reddit’s user agreements.
Ethics Under Fire
The study not only flouted subreddit rules but also sidestepped consent — a core principle in academic and human subject research. In response to the backlash, the University of Zurich promised that the study's results would not be published and that their ethics committee would adopt stricter oversight moving forward.
But the damage is already done. The incident underscores growing fears about AI's role in online spaces — especially its ability to pass as human and manipulate behavior.
The Bigger Picture: AI’s Infiltration of the Web
This experiment aligns with broader concerns about AI's expanding influence in digital discourse. Earlier this year, reports revealed that OpenAI's GPT-4.5 could pass the Turing test 73% of the time, fooling humans into thinking they were chatting with a fellow person.
As bots become more advanced and harder to detect, the “dead internet” theory — which suggests that much of the internet is already AI-generated — may feel less like a conspiracy and more like a cautionary tale.
Final Thoughts
This unsettling experiment is a wake-up call. It demonstrates that AI isn't just capable of generating content — it can actively influence thought, sentiment, and behavior, all under the radar. As we enter an era where distinguishing human from machine becomes harder than ever, one question remains:
How do we protect online communities from invisible manipulation?
Post a Comment
0Comments