AI Agents 相关度: 9/10

VLM-DEWM: Dynamic External World Model for Verifiable and Resilient Vision-Language Planning in Manufacturing

Guoqin Tang, Qingxuan Jia, Gang Chen, Tong Li, Zeyuan Huang, Zihang Lv, Ning Ji
arXiv: 2602.15549v1 发布: 2026-02-17 更新: 2026-02-17

AI 摘要

VLM-DEWM通过动态外部世界模型提升VLM在动态制造环境中的规划能力。

主要贡献

  • 提出了VLM-DEWM认知架构
  • 设计了可外部化的推理轨迹ERT
  • 实现了基于DEWM的故障诊断和恢复

方法论

构建动态外部世界模型DEWM,VLM决策分解为ERT,通过DEWM进行验证和故障诊断,实现鲁棒规划。

原文摘要

Vision-language model (VLM) shows promise for high-level planning in smart manufacturing, yet their deployment in dynamic workcells faces two critical challenges: (1) stateless operation, they cannot persistently track out-of-view states, causing world-state drift; and (2) opaque reasoning, failures are difficult to diagnose, leading to costly blind retries. This paper presents VLM-DEWM, a cognitive architecture that decouples VLM reasoning from world-state management through a persistent, queryable Dynamic External World Model (DEWM). Each VLM decision is structured into an Externalizable Reasoning Trace (ERT), comprising action proposal, world belief, and causal assumption, which is validated against DEWM before execution. When failures occur, discrepancy analysis between predicted and observed states enables targeted recovery instead of global replanning. We evaluate VLM-DEWM on multi-station assembly, large-scale facility exploration, and real-robot recovery under induced failures. Compared to baseline memory-augmented VLM systems, VLM DEWM improves state-tracking accuracy from 56% to 93%, increases recovery success rate from below 5% to 95%, and significantly reduces computational overhead through structured memory. These results establish VLM-DEWM as a verifiable and resilient solution for long-horizon robotic operations in dynamic manufacturing environments.

标签

VLM 智能制造 机器人 动态环境 世界模型

arXiv 分类

cs.RO cs.AI