LLM Memory & RAG 相关度: 9/10

Entropic Claim Resolution: Uncertainty-Driven Evidence Selection for RAG

Davide Di Gioia
arXiv: 2603.28444v1 发布: 2026-03-30 更新: 2026-03-30

AI 摘要

ECR通过最小化答案假设熵,动态选择证据,解决RAG中知识不确定性问题。

主要贡献

  • 提出 Entropic Claim Resolution (ECR) 算法
  • 使用期望熵减少 (EER) 进行证据选择
  • 定义了 epistemic sufficiency 的数学状态
  • 将 ECR 集成到生产级检索流程 CSGR++

方法论

ECR通过最大化信息价值的决策标准(EER)顺序选择证据,动态终止于知识充足状态。

原文摘要

Current Retrieval-Augmented Generation (RAG) systems predominantly rely on relevance-based dense retrieval, sequentially fetching documents to maximize semantic similarity with the query. However, in knowledge-intensive and real-world scenarios characterized by conflicting evidence or fundamental query ambiguity, relevance alone is insufficient for resolving epistemic uncertainty. We introduce Entropic Claim Resolution (ECR), a novel inference-time algorithm that reframes RAG reasoning as entropy minimization over competing semantic answer hypotheses. Unlike action-driven agentic frameworks (e.g., ReAct) or fixed-pipeline RAG architectures, ECR sequentially selects atomic evidence claims by maximizing Expected Entropy Reduction (EER), a decision-theoretic criterion for the value of information. The process dynamically terminates when the system reaches a mathematically defined state of epistemic sufficiency (H <= epsilon, subject to epistemic coherence). We integrate ECR into a production-grade multi-strategy retrieval pipeline (CSGR++) and analyze its theoretical properties. Our framework provides a rigorous foundation for uncertainty-aware evidence selection, shifting the paradigm from retrieving what is most relevant to retrieving what is most discriminative.

标签

RAG Uncertainty Entropy Evidence Selection Information Theory

arXiv 分类

cs.AI cs.CL