Multimodal Learning 相关度: 9/10

UniT: Unified Multimodal Chain-of-Thought Test-time Scaling

Leon Liangyu Chen, Haoyu Ma, Zhipeng Fan, Ziqi Huang, Animesh Sinha, Xiaoliang Dai, Jialiang Wang, Zecheng He, Jianwei Yang, Chunyuan Li, Junzhe Sun, Chu Wang, Serena Yeung-Levy, Felix Juefei-Xu
arXiv: 2602.12279v1 发布: 2026-02-12 更新: 2026-02-12

AI 摘要

UniT提出多模态链式思考测试时扩展框架,提升统一模型在复杂任务中的推理能力。

主要贡献

  • 提出UniT框架,实现多模态链式思考测试时扩展
  • 验证了统一模型在短推理轨迹上训练后,可泛化到更长的推理链
  • 证明了序列CoT比并行采样更高效

方法论

结合agentic数据合成、统一模型训练和灵活的测试时推理,使模型具备验证、分解子目标和内容记忆等认知行为。

原文摘要

Unified models can handle both multimodal understanding and generation within a single architecture, yet they typically operate in a single pass without iteratively refining their outputs. Many multimodal tasks, especially those involving complex spatial compositions, multiple interacting objects, or evolving instructions, require decomposing instructions, verifying intermediate results, and making iterative corrections. While test-time scaling (TTS) has demonstrated that allocating additional inference compute for iterative reasoning substantially improves language model performance, extending this paradigm to unified multimodal models remains an open challenge. We introduce UniT, a framework for multimodal chain-of-thought test-time scaling that enables a single unified model to reason, verify, and refine across multiple rounds. UniT combines agentic data synthesis, unified model training, and flexible test-time inference to elicit cognitive behaviors including verification, subgoal decomposition, and content memory. Our key findings are: (1) unified models trained on short reasoning trajectories generalize to longer inference chains at test time; (2) sequential chain-of-thought reasoning provides a more scalable and compute-efficient TTS strategy than parallel sampling; (3) training on generation and editing trajectories improves out-of-distribution visual reasoning. These results establish multimodal test-time scaling as an effective paradigm for advancing both generation and understanding in unified models.

标签

Multimodal Chain-of-Thought Test-Time Scaling Unified Model

arXiv 分类

cs.CV cs.AI cs.LG