AI Agents 相关度: 9/10

Stop Wandering: Efficient Vision-Language Navigation via Metacognitive Reasoning

Xueying Li, Feng Lyu, Hao Wu, Mingliu Liu, Jia-Nan Liu, Guozi Liu
arXiv: 2604.02318v1 发布: 2026-04-02 更新: 2026-04-02

AI 摘要

MetaNav通过空间记忆、历史感知规划和反思纠正,提升了视觉语言导航的效率和鲁棒性。

主要贡献

  • 提出了具有元认知能力的导航代理MetaNav
  • 引入空间记忆构建3D语义地图
  • 利用历史感知规划减少重复访问,提高效率
  • 采用反思纠正机制,使用LLM生成指导性规则

方法论

MetaNav结合空间记忆、历史感知规划和反思纠正,并通过LLM生成指导性规则,提升导航性能。

原文摘要

Training-free Vision-Language Navigation (VLN) agents powered by foundation models can follow instructions and explore 3D environments. However, existing approaches rely on greedy frontier selection and passive spatial memory, leading to inefficient behaviors such as local oscillation and redundant revisiting. We argue that this stems from a lack of metacognitive capabilities: the agent cannot monitor its exploration progress, diagnose strategy failures, or adapt accordingly. To address this, we propose MetaNav, a metacognitive navigation agent integrating spatial memory, history-aware planning, and reflective correction. Spatial memory builds a persistent 3D semantic map. History-aware planning penalizes revisiting to improve efficiency. Reflective correction detects stagnation and uses an LLM to generate corrective rules that guide future frontier selection. Experiments on GOAT-Bench, HM3D-OVON, and A-EQA show that MetaNav achieves state-of-the-art performance while reducing VLM queries by 20.7%, demonstrating that metacognitive reasoning significantly improves robustness and efficiency.

标签

视觉语言导航 元认知 空间记忆 LLM

arXiv 分类

cs.RO cs.CV