Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing
AI 摘要
SAVeR框架通过自审计验证LLM Agent内部信念状态,提升推理的忠实性,减少错误信息的传播。
主要贡献
- 提出了自审计验证推理框架SAVeR,用于提高LLM Agent的推理忠实性。
- 引入基于角色的多样化信念候选集生成方法。
- 采用对抗审计来定位违规行为,并通过约束引导下的最小干预进行修复。
方法论
SAVeR框架通过生成多样化信念候选集,对抗审计定位违规,并使用约束引导下的最小干预修复信念,实现推理忠实性。
原文摘要
In large language model (LLM) agents, reasoning trajectories are treated as reliable internal beliefs for guiding actions and updating memory. However, coherent reasoning can still violate logical or evidential constraints, allowing unsupported beliefs repeatedly stored and propagated across decision steps, leading to systematic behavioral drift in long-horizon agentic systems. Most existing strategies rely on the consensus mechanism, conflating agreement with faithfulness. In this paper, inspired by the vulnerability of unfaithful intermediate reasoning trajectories, we propose \textbf{S}elf-\textbf{A}udited \textbf{Ve}rified \textbf{R}easoning (\textsc{SAVeR}), a novel framework that enforces verification over internal belief states within the agent before action commitment, achieving faithful reasoning. Concretely, we structurally generate persona-based diverse candidate beliefs for selection under a faithfulness-relevant structure space. To achieve reasoning faithfulness, we perform adversarial auditing to localize violations and repair through constraint-guided minimal interventions under verifiable acceptance criteria. Extensive experiments on six benchmark datasets demonstrate that our approach consistently improves reasoning faithfulness while preserving competitive end-task performance.