Multimodal Learning 相关度: 9/10

Are VLMs Lost Between Sky and Space? LinkS$^2$Bench for UAV-Satellite Dynamic Cross-View Spatial Intelligence

Dian Liu, Jie Feng, Di Li, Yuhui Zheng, Guanbin Li, Weisheng Dong, Guangming Shi
arXiv: 2604.02020v1 发布: 2026-04-02 更新: 2026-04-02

AI 摘要

提出了LinkS$^2$Bench,用于评估VLM在无人机-卫星动态跨视角空间智能方面的能力。

主要贡献

  • 构建了首个无人机-卫星动态跨视角空间智能基准测试集LinkS$^2$Bench
  • 设计了Cross-View Alignment Adapter提升模型性能
  • 评估了18个VLMs并发现跨视角动态对齐是关键瓶颈

方法论

使用LMM辅助的流程和人工标注构建包含17.9k个问答对的LinkS$^2$Bench,并评估现有VLM。

原文摘要

Synergistic spatial intelligence between UAVs and satellites is indispensable for emergency response and security operations, as it uniquely integrates macro-scale global coverage with dynamic, real-time local perception. However, the capacity of Vision-Language Models (VLMs) to master this complex interplay remains largely unexplored. This gap persists primarily because existing benchmarks are confined to isolated Unmanned Aerial Vehicle (UAV) videos or static satellite imagery, failing to evaluate the dynamic local-to-global spatial mapping essential for comprehensive cross-view reasoning. To bridge this gap, we introduce LinkS$^2$Bench, the first comprehensive benchmark designed to evaluate VLMs' wide-area, dynamic cross-view spatial intelligence. LinkS$^2$Bench links 1,022 minutes of dynamic UAV footage with high-resolution satellite imagery covering over 200 km$^2$. Through an LMM-assisted pipeline and rigorous human annotation, we constructed 17.9k high-quality question-answer pairs comprising 12 fine-grained tasks across four dimensions: perception, localization, relation, and reasoning. Evaluations of 18 representative VLMs reveal a substantial gap compared to human baselines, identifying accurate cross-view dynamic alignment as the critical bottleneck. To alleviate this, we design a Cross-View Alignment Adapter, demonstrating that explicit alignment significantly improves model performance. Furthermore, fine-tuning experiments underscore the potential of LinkS$^2$Bench in advancing VLM adaptation for complex spatial reasoning.

标签

VLM Multimodal Learning UAV Satellite Imagery Cross-View Spatial Intelligence

arXiv 分类

cs.CV