AI Agents 相关度: 9/10

Towards Trustworthy Report Generation: A Deep Research Agent with Progressive Confidence Estimation and Calibration

Yi Yuan, Xuhong Wang, Shanzhe Lei
arXiv: 2604.05952v1 发布: 2026-04-07 更新: 2026-04-07

AI 摘要

提出一种新型深度研究Agent,通过置信度估计和校准生成更可信的报告。

主要贡献

  • 提出了一种结合置信度估计和校准的深度研究Agent
  • 设计了基于可验证证据的报告生成流程
  • 实验证明该方法提高了报告的可解释性和用户信任度

方法论

采用审慎的搜索模型,结合深度检索和多跳推理,并对每个声明分配置信度评分。

原文摘要

As agent-based systems continue to evolve, deep research agents are capable of automatically generating research-style reports across diverse domains. While these agents promise to streamline information synthesis and knowledge exploration, existing evaluation frameworks-typically based on subjective dimensions-fail to capture a critical aspect of report quality: trustworthiness. In open-ended research scenarios where ground-truth answers are unavailable, current evaluation methods cannot effectively measure the epistemic confidence of generated content, making calibration difficult and leaving users susceptible to misleading or hallucinated information. To address this limitation, we propose a novel deep research agent that incorporates progressive confidence estimation and calibration within the report generation pipeline. Our system leverages a deliberative search model, featuring deep retrieval and multi-hop reasoning to ground outputs in verifiable evidence while assigning confidence scores to individual claims. Combined with a carefully designed workflow, this approach produces trustworthy reports with enhanced transparency. Experimental results and case studies demonstrate that our method substantially improves interpretability and significantly increases user trust.

标签

AI Agent 可信报告生成 置信度估计 校准

arXiv 分类

cs.AI cs.CL