AI Agents 相关度: 9/10

Memory Intelligence Agent

Jingyang Qiao, Weicheng Meng, Yu Cheng, Zhihang Lin, Zhizhong Zhang, Xin Tan, Jingyu Gong, Kun Shao, Yuan Xie
arXiv: 2604.04503v1 发布: 2026-04-06 更新: 2026-04-06

AI 摘要

MIA框架通过双向记忆转换和在线学习,提升LLM Agent的推理和自进化能力。

主要贡献

  • 提出Memory Intelligence Agent (MIA)框架
  • 采用交替强化学习增强Planner和Executor的协作
  • 实现参数化和非参数化记忆之间的双向转换
  • 引入反射和无监督判断机制提升推理和自进化能力

方法论

构建Manager-Planner-Executor架构,通过交替强化学习、记忆转换和在线学习,优化Agent推理和记忆能力。

原文摘要

Deep research agents (DRAs) integrate LLM reasoning with external tools. Memory systems enable DRAs to leverage historical experiences, which are essential for efficient reasoning and autonomous evolution. Existing methods rely on retrieving similar trajectories from memory to aid reasoning, while suffering from key limitations of ineffective memory evolution and increasing storage and retrieval costs. To address these problems, we propose a novel Memory Intelligence Agent (MIA) framework, consisting of a Manager-Planner-Executor architecture. Memory Manager is a non-parametric memory system that can store compressed historical search trajectories. Planner is a parametric memory agent that can produce search plans for questions. Executor is another agent that can search and analyze information guided by the search plan. To build the MIA framework, we first adopt an alternating reinforcement learning paradigm to enhance cooperation between the Planner and the Executor. Furthermore, we enable the Planner to continuously evolve during test-time learning, with updates performed on-the-fly alongside inference without interrupting the reasoning process. Additionally, we establish a bidirectional conversion loop between parametric and non-parametric memories to achieve efficient memory evolution. Finally, we incorporate a reflection and an unsupervised judgment mechanisms to boost reasoning and self-evolution in the open world. Extensive experiments across eleven benchmarks demonstrate the superiority of MIA.

标签

AI Agent Memory Reinforcement Learning Self-Evolution

arXiv 分类

cs.AI cs.MA