LLM Reasoning 相关度: 9/10

Correct Prediction, Wrong Steps? Consensus Reasoning Knowledge Graph for Robust Chain-of-Thought Synthesis

Zipeng Ling, Shuliang Liu, Shenghong Fu, Yuehao Tang, Seonil Son, Yao Wan, Xuming Hu
arXiv: 2604.14121v1 发布: 2026-04-15 更新: 2026-04-15

AI 摘要

CRAFT框架通过共识推理知识图谱提升LLM推理的准确性和推理链质量。

主要贡献

  • 提出CRAFT框架,缓解推理步骤中的内部和步骤间缺陷
  • 构建基于共识的推理知识图谱(RKG)
  • 通过拓扑生成高质量的推理链

方法论

构建RKG,基于多个候选推理链的共识部分,并通过拓扑生成合成高质量推理链。

原文摘要

LLM reasoning traces suffer from complex flaws -- *Step Internal Flaws* (logical errors, hallucinations, etc.) and *Step-wise Flaws* (overthinking, underthinking), which vary by sample. A natural approach would be to provide ground-truth labels to guide LLMs' reasoning. Contrary to intuition, we show that this yields no improvement in reasoning ability. We then propose CRAFT, a unified framework that mitigates both types of Step flaws, which builds a Reasoning Knowledge Graph (RKG) based on the consensus parts of multiple candidate traces, and synthesizes a high-quality trace through topological generation. Our approach improves label-prediction accuracy by 10+% on average, and consistently outperforms all baselines across both logical and mathematical reasoning benchmarks. Further, detailed benchmark evaluation proves that our method also improves the quality of LLMs' reasoning traces in multiple dimensions.

标签

LLM Reasoning Chain-of-Thought Knowledge Graph

arXiv 分类

cs.CL