Multimodal Learning 相关度: 9/10

SURE: Synergistic Uncertainty-aware Reasoning for Multimodal Emotion Recognition in Conversations

Yiqiang Cai, Chengyan Wu, Bolei Ma, Bo Chen, Yun Xue, Julia Hirschberg, Ziwei Gong
arXiv: 2604.01916v1 发布: 2026-04-02 更新: 2026-04-02

AI 摘要

SURE模型通过协同不确定性感知推理,提升对话场景下多模态情感识别的鲁棒性和上下文建模能力。

主要贡献

  • 提出不确定性感知的专家混合模块
  • 设计迭代推理模块进行多轮上下文推理
  • 构建Transformer门控模块捕捉模态间交互

方法论

构建SURE框架,融合不确定性专家混合、迭代推理及Transformer门控模块,增强噪声鲁棒性和上下文理解。

原文摘要

Multimodal emotion recognition in conversations (MERC) requires integrating multimodal signals while being robust to noise and modeling contextual reasoning. Existing approaches often emphasize fusion but overlook uncertainty in noisy features and fine-grained reasoning. We propose SURE (Synergistic Uncertainty-aware REasoning) for MERC, a framework that improves robustness and contextual modeling. SURE consists of three components: an Uncertainty-Aware Mixture-of-Experts module to handle modality-specific noise, an Iterative Reasoning module for multi-turn reasoning over context, and a Transformer Gate module to capture intra- and inter-modal interactions. Experiments on benchmark MERC datasets show that SURE consistently outperforms state-of-the-art methods, demonstrating its effectiveness in robust multimodal reasoning. These results highlight the importance of uncertainty modeling and iterative reasoning in advancing emotion recognition in conversational settings.

标签

多模态情感识别 上下文推理 不确定性建模

arXiv 分类

cs.CL