Multimodal Learning 相关度: 9/10

MISID: A Multimodal Multi-turn Dataset for Complex Intent Recognition in Strategic Deception Games

Shufang Lin, Muyang Chen, Xiabing Zhou, Rongrong Zhang, Dayou Zhang, Fangxin Wang
arXiv: 2604.12700v1 发布: 2026-04-14 更新: 2026-04-14

AI 摘要

MISID是一个多模态、多轮次的意图识别数据集,用于解决复杂战略欺骗游戏中意图识别的挑战。

主要贡献

  • 构建了用于意图识别的多模态、多轮次数据集MISID
  • 提出了针对复杂场景的FRACTAM基线框架
  • 揭示了现有MLLM在复杂意图识别中的不足

方法论

提出了FRACTAM框架,采用“解耦-锚定-推理”范式,通过提取单模态特征、检索长程事实和构建显式证据链来增强模型性能。

原文摘要

Understanding human intent in complex multi-turn interactions remains a fundamental challenge in human-computer interaction and behavioral analysis. While existing intent recognition datasets focus mainly on single utterances or simple dialogues, real-world scenarios often involve sophisticated strategic interactions where participants must maintain complex deceptive narratives over extended periods. To address this gap, we introduce MISID, a comprehensive multimodal, multi-turn, and multi-participant benchmark for intent recognition. Sourced from high-stakes social strategy games, MISID features a fine-grained, two-tier multi-dimensional annotation scheme tailored for long-context discourse analysis and evidence-based causal tracking. Our systematic evaluation of state-of-the-art Multimodal Large Language Models (MLLMs) on MISID reveals critical deficiencies in complex scenarios, including text-prior visual hallucination, impaired cross-modal synergy, and limited capacity in chaining causal cues. Consequently, we propose FRACTAM as a baseline framework. Using a ``Decouple-Anchor-Reason'' paradigm, FRACTAM reduces text bias by extracting pure unimodal factual representations, employs two-stage retrieval for long-range factual anchoring, and constructs explicit cross-modal evidence chains. Extensive experiments demonstrate that FRACTAM enhances mainstream models' performance in complex strategic tasks, improving hidden intent detection and inference while maintaining robust perceptual accuracy. Our dataset is available at https://naislab.cn/datasets/MISID.

标签

Multimodal Learning Intent Recognition Deception Detection

arXiv 分类

cs.AI