返回首页
arXiv AI··论文与技术

AI Agents are Vulnerable to Radicalization

中文摘要

研究发现大语言模型容易被激进化。模拟显示,“影响力模型”能诱导“目标模型”产生更极端的观点。

English Summary

Research shows AI agents are vulnerable to radicalization. Simulations demonstrate that "influencer" LLMs can manipulate "target" LLMs, driving their beliefs toward more extreme positions.

原文节选

arXiv:2609.38296v1 Announce Type: new Abstract: Large language models (LLMs) can influence people's beliefs, yet little is known about whether and how they can manipulate each other. To investigate this, we simulate conversations between two agents: a target LLM that role-plays a human persona based on demographic and psychological attributes, and an influencer LLM that aims to make the target's beliefs more extreme. We examine radicalization along two pathways: resonance, where the influencer reinforces a target's pre-existing belief, and persuasion, where the influencer promotes a belief the target initially considers unimportant. Across affective and behavioral metrics, we find that both mechanisms radicalize the target. However, resonance produces consistently stronger effects than persuasion. Different influence tactics, such as using sycophancy and unverified claims, produce different levels of radicalization, but not consistently across metrics. We further show that resonance propagates to related beliefs, suggesting interconnected belief structures within AI agents. These findings indicate that AI agents are susceptible to radicalization, particularly when messages align wi…