LLM Reasoning 相关度: 9/10

Co-FactChecker: A Framework for Human-AI Collaborative Claim Verification Using Large Reasoning Models

Dhruv Sahnan, Subhabrata Dutta, Tanmoy Chakraborty, Preslav Nakov, Iryna Gurevych
arXiv: 2604.13706v1 发布: 2026-04-15 更新: 2026-04-15

AI 摘要

提出Co-FactChecker框架,利用人类专家反馈指导LLM进行更有效的协同事实核查。

主要贡献

  • 提出Co-FactChecker框架
  • 引入基于痕迹编辑的人机交互范式
  • 理论证明痕迹编辑优于多轮对话
  • 实验验证Co-FactChecker优于现有方法

方法论

通过将专家反馈转化为痕迹编辑,有针对性地修改LLM的思维轨迹,实现人机协同的事实核查。

原文摘要

Professional fact-checkers rely on domain knowledge and deep contextual understanding to verify claims. Large language models (LLMs) and large reasoning models (LRMs) lack such grounding and primarily reason from available evidence alone, creating a mismatch between expert-led and fully automated claim verification. To mitigate this gap, we posit human-AI collaboration as a more promising path forward, where expert feedback, grounded in real-world knowledge and domain expertise, guides the model's reasoning. However, existing LRMs are hard to calibrate to natural language feedback, particularly in a multi-turn interaction setup. We propose Co-FactChecker, a framework for human-AI collaborative claim verification. We introduce a new interaction paradigm that treats the model's thinking trace as a shared scratchpad. Co-FactChecker translates expert feedback into trace-edits that introduce targeted modifications to the trace, sidestepping the shortcomings of dialogue-based interaction. We provide theoretical results showing that trace-editing offers advantages over multi-turn dialogue, and our automatic evaluations demonstrate that Co-FactChecker outperforms existing autonomous and human-AI collaboration approaches. Human evaluations further show that Co-FactChecker is preferred over multi-turn dialogue, producing higher quality reasoning and verdicts along with relatively easier to interpret and more useful thinking traces.

标签

事实核查 人机协作 大语言模型 推理 痕迹编辑

arXiv 分类

cs.CL