Context-Value-Action Architecture for Value-Driven Large Language Model Agents
AI 摘要
CVA架构通过解耦推理和行为生成,提升LLM Agent的行为真实性和多样性,并降低极化现象。
主要贡献
- 提出了Context-Value-Action (CVA) 架构
- 引入了基于真实人类数据的Value Verifier
- 在CVABench上验证了CVA的有效性,降低了极化并提升了行为保真度和可解释性
方法论
基于S-O-R模型和Schwartz价值理论,解耦推理和行为,使用Value Verifier动态建模价值观激活,并在真实世界数据上进行训练和评估。
原文摘要
Large Language Models (LLMs) have shown promise in simulating human behavior, yet existing agents often exhibit behavioral rigidity, a flaw frequently masked by the self-referential bias of current "LLM-as-a-judge" evaluations. By evaluating against empirical ground truth, we reveal a counter-intuitive phenomenon: increasing the intensity of prompt-driven reasoning does not enhance fidelity but rather exacerbates value polarization, collapsing population diversity. To address this, we propose the Context-Value-Action (CVA) architecture, grounded in the Stimulus-Organism-Response (S-O-R) model and Schwartz's Theory of Basic Human Values. Unlike methods relying on self-verification, CVA decouples action generation from cognitive reasoning via a novel Value Verifier trained on authentic human data to explicitly model dynamic value activation. Experiments on CVABench, which comprises over 1.1 million real-world interaction traces, demonstrate that CVA significantly outperforms baselines. Our approach effectively mitigates polarization while offering superior behavioral fidelity and interpretability.