AI Agents 相关度: 8/10

NavTrust: Benchmarking Trustworthiness for Embodied Navigation

Huaide Jiang, Yash Chaudhary, Yuping Wang, Zehao Wang, Raghav Sharma, Manan Mehta, Yang Zhou, Lichao Sun, Zhiwen Fan, Zhengzhong Tu, Jiachen Li
arXiv: 2603.19229v1 发布: 2026-03-19 更新: 2026-03-19

AI 摘要

NavTrust提出了一个统一的benchmark,用于评估具身导航在现实场景中面对输入扰动时的鲁棒性。

主要贡献

  • 提出了NavTrust benchmark,用于评估具身导航系统的鲁棒性。
  • 系统地引入了RGB-Depth corruptions和instruction variations。
  • 评估了现有方法在扰动下的性能下降情况,并提出了缓解策略。

方法论

构建统一的benchmark,对RGB、深度和指令进行系统性扰动,评估现有模型性能,并提出缓解策略。

原文摘要

There are two major categories of embodied navigation: Vision-Language Navigation (VLN), where agents navigate by following natural language instructions; and Object-Goal Navigation (OGN), where agents navigate to a specified target object. However, existing work primarily evaluates model performance under nominal conditions, overlooking the potential corruptions that arise in real-world settings. To address this gap, we present NavTrust, a unified benchmark that systematically corrupts input modalities, including RGB, depth, and instructions, in realistic scenarios and evaluates their impact on navigation performance. To our best knowledge, NavTrust is the first benchmark that exposes embodied navigation agents to diverse RGB-Depth corruptions and instruction variations in a unified framework. Our extensive evaluation of seven state-of-the-art approaches reveals substantial performance degradation under realistic corruptions, which highlights critical robustness gaps and provides a roadmap toward more trustworthy embodied navigation systems. Furthermore, we systematically evaluate four distinct mitigation strategies to enhance robustness against RGB-Depth and instructions corruptions. Our base models include Uni-NaVid and ETPNav. We deployed them on a real mobile robot and observed improved robustness to corruptions. The project website is: https://navtrust.github.io.

标签

embodied navigation trustworthiness robustness benchmark corruptions

arXiv 分类

cs.RO cs.AI cs.CV cs.LG eess.SY