BiMind: A Dual-Head Reasoning Model with Attention-Geometry Adapter for Incorrect Information Detection
AI 摘要
BiMind模型通过双头推理和注意力几何适配器提升错误信息检测的准确性和可解释性。
主要贡献
- 提出注意力几何适配器缓解注意力崩溃
- 引入自检索知识机制增强外部知识
- 设计不确定性感知融合策略
方法论
构建双头推理框架,分别进行内容内部推理和知识增强推理,并通过特定模块进行适配和融合。
原文摘要
Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification under collapsed attention geometries. To address this issue, we propose a dual-head reasoning framework, BiMind, which disentangles content-internal reasoning from knowledge-augmented reasoning. In BiMind, we introduce three core innovations: (i) an attention geometry adapter that reshapes attention logits via token-conditioned offsets and mitigates attention collapse; (ii) a self-retrieval knowledge mechanism, which constructs an in-domain semantic memory through kNN retrieval and injects retrieved neighbors via feature-wise linear modulation; (iii) the uncertainty-aware fusion strategies, including entropy-gated fusion and a trainable agreement head, stabilized by a symmetric Kullback-Leibler agreement regularizer. To quantify the knowledge contributions, we define a novel metric, Value-of-eXperience (VoX), to measure instance-wise logit gains from knowledge-augmented reasoning. Experiment results on public datasets demonstrate that our BiMind model outperforms advanced detection approaches and provides interpretable diagnostics on when and why knowledge matters.