LLM Memory & RAG 相关度: 9/10

Retrieval as Generation: A Unified Framework with Self-Triggered Information Planning

Bo Li, Mingda Wang, Gexiang Fang, Shikun Zhang, Wei Ye
arXiv: 2604.11407v1 发布: 2026-04-13 更新: 2026-04-13

AI 摘要

GRIP将检索控制嵌入生成过程,实现端到端的检索增强生成,提升问答效果。

主要贡献

  • 提出了GRIP框架,统一检索和生成
  • 引入了Self-Triggered Information Planning机制,动态控制检索
  • 构建了结构化训练集,监督检索行为

方法论

GRIP通过控制token的发射,模型自主决定何时检索、如何查询和何时终止,实现动态多步推理。

原文摘要

We revisit retrieval-augmented generation (RAG) by embedding retrieval control directly into generation. Instead of treating retrieval as an external intervention, we express retrieval decisions within token-level decoding, enabling end-to-end coordination without additional controllers or classifiers. Under the paradigm of Retrieval as Generation, we propose \textbf{GRIP} (\textbf{G}eneration-guided \textbf{R}etrieval with \textbf{I}nformation \textbf{P}lanning), a unified framework in which the model regulates retrieval behavior through control-token emission. Central to GRIP is \textit{Self-Triggered Information Planning}, which allows the model to decide when to retrieve, how to reformulate queries, and when to terminate, all within a single autoregressive trajectory. This design tightly couples retrieval and reasoning and supports dynamic multi-step inference with on-the-fly evidence integration. To supervise these behaviors, we construct a structured training set covering answerable, partially answerable, and multi-hop queries, each aligned with specific token patterns. Experiments on five QA benchmarks show that GRIP surpasses strong RAG baselines and is competitive with GPT-4o while using substantially fewer parameters.

标签

RAG 检索增强生成 信息规划 问答

arXiv 分类

cs.CL cs.AI