Multimodal Learning 相关度: 9/10

TranX-Adapter: Bridging Artifacts and Semantics within MLLMs for Robust AI-generated Image Detection

Wenbin Wang, Yuge Huang, Jianqing Xu, Yue Yu, Jiangtao Yan, Shouhong Ding, Pan Zhou, Yong Luo
arXiv: 2602.21716v1 发布: 2026-02-25 更新: 2026-02-25

AI 摘要

TranX-Adapter 通过优化 MLLM 中语义和伪影特征的融合,提升 AI 生成图像检测的鲁棒性。

主要贡献

  • 提出 TranX-Adapter,一种轻量级的融合适配器
  • 引入 Task-aware Optimal-Transport Fusion,利用 Jensen-Shannon 散度传递伪影信息
  • 引入 X-Fusion,通过交叉注意力传递语义信息

方法论

提出 TranX-Adapter,包含 Task-aware Optimal-Transport Fusion 和 X-Fusion 两个模块,分别进行伪影到语义和语义到伪影的信息传递。

原文摘要

Rapid advances in AI-generated image (AIGI) technology enable highly realistic synthesis, threatening public information integrity and security. Recent studies have demonstrated that incorporating texture-level artifact features alongside semantic features into multimodal large language models (MLLMs) can enhance their AIGI detection capability. However, our preliminary analyses reveal that artifact features exhibit high intra-feature similarity, leading to an almost uniform attention map after the softmax operation. This phenomenon causes attention dilution, thereby hindering effective fusion between semantic and artifact features. To overcome this limitation, we propose a lightweight fusion adapter, TranX-Adapter, which integrates a Task-aware Optimal-Transport Fusion that leverages the Jensen-Shannon divergence between artifact and semantic prediction probabilities as a cost matrix to transfer artifact information into semantic features, and an X-Fusion that employs cross-attention to transfer semantic information into artifact features. Experiments on standard AIGI detection benchmarks upon several advanced MLLMs, show that our TranX-Adapter brings consistent and significant improvements (up to +6% accuracy).

标签

AI生成图像检测 MLLM 特征融合 Optimal-Transport 交叉注意力

arXiv 分类

cs.CV