Multimodal Learning 相关度: 9/10

SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM

Chuanrui Zhang, Minghan Qin, Yuang Wang, Baifeng Xie, Hang Li, Ziwei Wang
arXiv: 2603.23386v1 发布: 2026-03-24 更新: 2026-03-24

AI 摘要

SIMART通过MLLM将静态网格分解为可用于物理模拟的铰接资产。

主要贡献

  • 提出基于MLLM的单阶段关节资产创建方法
  • 引入Sparse 3D VQ-VAE减少token数量
  • 在PartNet-Mobility和AIGC数据集上取得SOTA

方法论

使用统一的MLLM框架,结合Sparse 3D VQ-VAE,进行零件级分解和运动学预测。

原文摘要

High-quality articulated 3D assets are indispensable for embodied AI and physical simulation, yet 3D generation still focuses on static meshes, leaving a gap in "sim-ready" interactive objects. Most recent articulated object creation methods rely on multi-stage pipelines that accumulate errors across decoupled modules. Alternatively, unified MLLMs offer a single-stage path to joint static asset understanding and sim-ready asset generation. However dense voxel-based 3D tokenization yields long 3D token sequences and high memory overhead, limiting scalability to complex articulated objects. To address this, we propose SIMART, a unified MLLM framework that jointly performs part-level decomposition and kinematic prediction. By introducing a Sparse 3D VQ-VAE, SIMART reduces token counts by 70% vs. dense voxel tokens, enabling high-fidelity multi-part assemblies. SIMART achieves state-of-the-art performance on PartNet-Mobility and in-the-wild AIGC datasets, and enables physics-based robotic simulation.

标签

MLLM 3D建模 关节资产 物理模拟

arXiv 分类

cs.CV cs.GR cs.RO