Multimodal Learning 相关度: 9/10

RoboGene: Boosting VLA Pre-training via Diversity-Driven Agentic Framework for Real-World Task Generation

Yixue Zhang, Kun Wu, Zhi Gao, Zhen Zhao, Pei Ren, Zhiyuan Xu, Fei Liao, Xinhua Wang, Shichao Fan, Di Wu, Qiuxuan Feng, Meng Li, Zhengping Che, Chang Liu, Jian Tang
arXiv: 2602.16444v1 发布: 2026-02-18 更新: 2026-02-18

AI 摘要

RoboGene自动化生成多样且符合物理规律的机器人任务,提升VLA预训练效果。

主要贡献

  • 提出RoboGene框架,用于自动化生成机器人任务
  • 结合多样性驱动采样、自反思机制和人机协作
  • 收集了18k轨迹的真实世界数据集,并提出评估指标

方法论

RoboGene通过多样性驱动采样生成任务,自反思机制保证物理可行性,人机协作进行优化。

原文摘要

The pursuit of general-purpose robotic manipulation is hindered by the scarcity of diverse, real-world interaction data. Unlike data collection from web in vision or language, robotic data collection is an active process incurring prohibitive physical costs. Consequently, automated task curation to maximize data value remains a critical yet under-explored challenge. Existing manual methods are unscalable and biased toward common tasks, while off-the-shelf foundation models often hallucinate physically infeasible instructions. To address this, we introduce RoboGene, an agentic framework designed to automate the generation of diverse, physically plausible manipulation tasks across single-arm, dual-arm, and mobile robots. RoboGene integrates three core components: diversity-driven sampling for broad task coverage, self-reflection mechanisms to enforce physical constraints, and human-in-the-loop refinement for continuous improvement. We conduct extensive quantitative analysis and large-scale real-world experiments, collecting datasets of 18k trajectories and introducing novel metrics to assess task quality, feasibility, and diversity. Results demonstrate that RoboGene significantly outperforms state-of-the-art foundation models (e.g., GPT-4o, Gemini 2.5 Pro). Furthermore, real-world experiments show that VLA models pre-trained with RoboGene achieve higher success rates and superior generalization, underscoring the importance of high-quality task generation. Our project is available at https://robogene-boost-vla.github.io.

标签

机器人 任务生成 VLA预训练 多模态学习

arXiv 分类

cs.RO cs.AI cs.LG