Multimodal Learning 相关度: 9/10

Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models

Xiaohe Li, Jiahao Li, Kaixin Zhang, Yuqiang Fang, Leilei Lin, Hong Wang, Haohua Wu, Zide Fan
arXiv: 2604.14044v1 发布: 2026-04-15 更新: 2026-04-15

AI 摘要

提出Delta-LLaVA,一个针对遥感变化理解的MLLM框架,解决时序盲区问题,实现高精度变化检测。

主要贡献

  • 提出Delta-QA基准数据集
  • 提出Delta-LLaVA框架
  • Change-Enhanced Attention模块
  • Change-SEG模块
  • Local Causal Attention模块

方法论

构建新数据集,设计新颖的模块来增强MLLM对时序变化的感知和处理能力,从而提升遥感图像变化检测精度。

原文摘要

While Multimodal Large Language Models (MLLMs) excel in general vision-language tasks, their application to remote sensing change understanding is hindered by a fundamental "temporal blindness". Existing architectures lack intrinsic mechanisms for multi-temporal contrastive reasoning and struggle with precise spatial grounding. To address this, we first introduce Delta-QA, a comprehensive benchmark comprising 180k visual question-answering samples. Delta-QA unifies pixel-level segmentation and visual question answering across bi- and tri-temporal scenarios, structuring change interpretation into four progressive cognitive dimensions. Methodologically, we propose Delta-LLaVA, a novel MLLM framework explicitly tailored for multi-temporal remote sensing interpretation. It overcomes the limitations of naive feature concatenation through three core innovations: a Change-Enhanced Attention module that systematically isolates and amplifies visual differences, a Change-SEG module utilizing Change Prior Embedding to extract differentiable difference features as input for the LLM, and Local Causal Attention to prevent cross-temporal contextual leakage. Extensive experiments demonstrate that Delta-LLaVA decisively outperforms leading generalist MLLMs and specialized segmentation models in complex change deduction and high-precision boundary localization, establishing a unified framework for earth observation intelligence.

标签

遥感 变化检测 多模态学习 大语言模型 时序分析

arXiv 分类

cs.CV