Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models
AI 摘要
提出Delta-LLaVA,一个针对遥感变化理解的MLLM框架,解决时序盲区问题,实现高精度变化检测。
主要贡献
- 提出Delta-QA基准数据集
- 提出Delta-LLaVA框架
- Change-Enhanced Attention模块
- Change-SEG模块
- Local Causal Attention模块
方法论
构建新数据集,设计新颖的模块来增强MLLM对时序变化的感知和处理能力,从而提升遥感图像变化检测精度。
原文摘要
While Multimodal Large Language Models (MLLMs) excel in general vision-language tasks, their application to remote sensing change understanding is hindered by a fundamental "temporal blindness". Existing architectures lack intrinsic mechanisms for multi-temporal contrastive reasoning and struggle with precise spatial grounding. To address this, we first introduce Delta-QA, a comprehensive benchmark comprising 180k visual question-answering samples. Delta-QA unifies pixel-level segmentation and visual question answering across bi- and tri-temporal scenarios, structuring change interpretation into four progressive cognitive dimensions. Methodologically, we propose Delta-LLaVA, a novel MLLM framework explicitly tailored for multi-temporal remote sensing interpretation. It overcomes the limitations of naive feature concatenation through three core innovations: a Change-Enhanced Attention module that systematically isolates and amplifies visual differences, a Change-SEG module utilizing Change Prior Embedding to extract differentiable difference features as input for the LLM, and Local Causal Attention to prevent cross-temporal contextual leakage. Extensive experiments demonstrate that Delta-LLaVA decisively outperforms leading generalist MLLMs and specialized segmentation models in complex change deduction and high-precision boundary localization, establishing a unified framework for earth observation intelligence.