Multimodal Learning 相关度: 9/10

Probabilistic Concept Graph Reasoning for Multimodal Misinformation Detection

Ruichao Yang, Wei Gao, Xiaobin Zhu, Jing Ma, Hongzhan Lin, Ziyang Luo, Bo-Wen Zhang, Xu-Cheng Yin
arXiv: 2603.25203v1 发布: 2026-03-26 更新: 2026-03-26

AI 摘要

提出PCGR框架,利用概率概念图推理提升多模态错误信息检测的准确性和可解释性。

主要贡献

  • 提出PCGR框架,实现可解释的多模态错误信息检测
  • 利用MLLM自动发现和验证高层概念
  • 在MMD任务上达到SOTA,并具有鲁棒性

方法论

构建概念图,节点表示概念,边表示关系,利用层次注意力机制进行推理,判断信息真伪。

原文摘要

Multimodal misinformation poses an escalating challenge that often evades traditional detectors, which are opaque black boxes and fragile against new manipulation tactics. We present Probabilistic Concept Graph Reasoning (PCGR), an interpretable and evolvable framework that reframes multimodal misinformation detection (MMD) as structured and concept-based reasoning. PCGR follows a build-then-infer paradigm, which first constructs a graph of human-understandable concept nodes, including novel high-level concepts automatically discovered and validated by multimodal large language models (MLLMs), and then applies hierarchical attention over this concept graph to infer claim veracity. This design produces interpretable reasoning chains linking evidence to conclusions. Experiments demonstrate that PCGR achieves state-of-the-art MMD accuracy and robustness to emerging manipulation types, outperforming prior methods in both coarse detection and fine-grained manipulation recognition.

标签

多模态 错误信息检测 概念图 推理 可解释性

arXiv 分类

cs.CV cs.CL