Multimodal Learning 相关度: 9/10

Vero: An Open RL Recipe for General Visual Reasoning

Gabriel Sarch, Linrong Cai, Qunzhong Wang, Haoyang Wu, Danqi Chen, Zhuang Liu
arXiv: 2604.04917v1 发布: 2026-04-06 更新: 2026-04-06

AI 摘要

Vero开源了一系列视觉语言模型,通过大规模RL数据和任务路由奖励,在视觉推理任务上取得优异表现。

主要贡献

  • 开源了Vero系列视觉语言模型
  • 构建了包含59个数据集的Vero-600K数据集
  • 设计了任务路由奖励机制
  • 在多个视觉推理基准测试中达到SOTA

方法论

通过强化学习,利用包含六大类任务的600K样本数据集训练视觉语言模型,并设计任务路由奖励机制。

原文摘要

What does it take to build a visual reasoner that works across charts, science, spatial understanding, and open-ended tasks? The strongest vision-language models (VLMs) show such broad visual reasoning is within reach, but the recipe behind them remains unclear, locked behind proprietary reinforcement learning (RL) pipelines with non-public data. We introduce Vero, a family of fully open VLMs that matches or exceeds existing open-weight models across diverse visual reasoning tasks. We scale RL data and rewards across six broad task categories, constructing Vero-600K, a 600K-sample dataset from 59 datasets, and designing task-routed rewards that handle heterogeneous answer formats. Vero achieves state-of-the-art performance, improving over four base models by 3.7-5.5 points on average across VeroEval, our suite of 30 challenging benchmarks. Starting from Qwen3-VL-8B-Instruct, Vero outperforms Qwen3-VL-8B-Thinking on 23 of 30 benchmarks without additional proprietary thinking data. When trained from the same base model, Vero-600K exceeds existing RL datasets across task categories. Systematic ablations reveal that different task categories elicit qualitatively distinct reasoning patterns that transfer poorly in isolation, suggesting that broad data coverage is the primary driver of strong RL scaling. All data, code, and models are released.

标签

VLM 视觉推理 强化学习 开源

arXiv 分类

cs.CV cs.AI cs.CL