Multimodal Learning 相关度: 8/10

OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligence

Jianhui Liu, Haoze Sun, Wenbo Li, Yanbing Zhang, Rui Yang, Zhiliang Zhu, Yijun Yang, Shenghe Zheng, Nan Jiang, Jiaxiu Jiang, Haoyang Huang, Tien-Tsin Wong, Nan Duan, Xiaojuan Qi
arXiv: 2604.07296v1 发布: 2026-04-08 更新: 2026-04-08

AI 摘要

OpenSpatial提供了一个开源空间数据引擎,并构建了大规模高质量数据集,显著提升空间推理能力。

主要贡献

  • 提出了一个原则性的空间数据生成系统OpenSpatial
  • 构建了一个大规模高质量数据集OpenSpatial-3M
  • 验证了OpenSpatial在多个空间推理任务上的有效性

方法论

构建基于3D bounding boxes的数据层级结构,涵盖空间测量、关系、感知、一致性、推理等任务,并训练模型进行评估。

原文摘要

Spatial understanding is a fundamental cornerstone of human-level intelligence. Nonetheless, current research predominantly focuses on domain-specific data production, leaving a critical void: the absence of a principled, open-source engine capable of fully unleashing the potential of high-quality spatial data. To bridge this gap, we elucidate the design principles of a robust data generation system and introduce OpenSpatial -- an open-source data engine engineered for high quality, extensive scalability, broad task diversity, and optimized efficiency. OpenSpatial adopts 3D bounding boxes as the fundamental primitive to construct a comprehensive data hierarchy across five foundational tasks: Spatial Measurement (SM), Spatial Relationship (SR), Camera Perception (CP), Multi-view Consistency (MC), and Scene-Aware Reasoning (SAR). Leveraging this scalable infrastructure, we curate OpenSpatial-3M, a large-scale dataset comprising 3 million high-fidelity samples. Extensive evaluations demonstrate that versatile models trained on our dataset achieve state-of-the-art performance across a wide spectrum of spatial reasoning benchmarks. Notably, the best-performing model exhibits a substantial average improvement of 19 percent, relatively. Furthermore, we provide a systematic analysis of how data attributes influence spatial perception. By open-sourcing both the engine and the 3M-scale dataset, we provide a robust foundation to accelerate future research in spatial intelligence.

标签

空间智能 数据集 数据引擎 3D视觉 空间推理

arXiv 分类

cs.CL