AI Agents 相关度: 9/10

How Much LLM Does a Self-Revising Agent Actually Need?

Seongwoo Jeong, Seonil Son
arXiv: 2604.07236v1 发布: 2026-04-08 更新: 2026-04-08

AI 摘要

研究LLM Agent中LLM和外部结构各自的作用,发现外部结构的重要性。

主要贡献

  • 提出了一个可声明的反射运行时协议,用于外部化Agent状态。
  • 通过实验分解和评估了Agent的各个组件,包括LLM修订。
  • 发现显式世界模型规划对Agent性能有显著提升。

方法论

通过声明反射运行时协议,将Agent行为外部化,隔离LLM的 marginal role。在协同战舰游戏中评估不同结构Agent。

原文摘要

Recent LLM-based agents often place world modeling, planning, and reflection inside a single language model loop. This can produce capable behavior, but it makes a basic scientific question difficult to answer: which part of the agent's competence actually comes from the LLM, and which part comes from explicit structure around it? We study this question not by claiming a general answer, but by making it empirically tractable. We introduce a declared reflective runtime protocol that externalizes agent state, confidence signals, guarded actions, and hypothetical transitions into inspectable runtime structure. We instantiate this protocol in a declarative runtime and evaluate it on noisy Collaborative Battleship [4] using four progressively structured agents over 54 games (18 boards $\times$ 3 seeds). The resulting decomposition isolates four components: posterior belief tracking, explicit world-model planning, symbolic in-episode reflection, and sparse LLM-based revision. Across this decomposition, explicit world-model planning improves substantially over a greedy posterior-following baseline (+24.1pp win rate, +0.017 F1). Symbolic reflection operates as a real runtime mechanism -- with prediction tracking, confidence gating, and guarded revision actions -- even though its current revision presets are not yet net-positive in aggregate. Adding conditional LLM revision at about 4.3\% of turns yields only a small and non-monotonic change: average F1 rises slightly (+0.005) while win rate drops (31$\rightarrow$29 out of 54). These results suggest a methodological contribution rather than a leaderboard claim: externalizing reflection turns otherwise latent agent behavior into inspectable runtime structure, allowing the marginal role of LLM intervention to be studied directly.

标签

LLM Agent Reflection World Model Decomposition

arXiv 分类

cs.AI cs.CL