VLA-IAP: Training-Free Visual Token Pruning via Interaction Alignment for Vision-Language-Action Models
AI 摘要
VLA-IAP是一种训练无关的视觉token剪枝方法,通过交互对齐提升VLA模型在资源受限平台上的推理效率。
主要贡献
- 提出基于几何先验的结构锚点保留机制
- 设计基于语义-运动对齐的动态剪枝强度调度策略
- VLA-IAP在多个仿真环境和真实机器人平台上验证了其通用性和实用性
方法论
VLA-IAP引入了几何先验来保留结构锚点,并采用动态调度策略根据语义-运动对齐自适应调整剪枝强度,实现保守到激进的转变。
原文摘要
Vision-Language-Action (VLA) models have rapidly advanced embodied intelligence, enabling robots to execute complex, instruction-driven tasks. However, as model capacity and visual context length grow, the inference cost of VLA systems becomes a major bottleneck for real-world deployment on resource-constrained platforms. Existing visual token pruning methods mainly rely on semantic saliency or simple temporal cues, overlooking the continuous physical interaction, a fundamental property of VLA tasks. Consequently, current approaches often prune visually sparse yet structurally critical regions that support manipulation, leading to unstable behavior during early task phases. To overcome this, we propose a shift toward an explicit Interaction-First paradigm. Our proposed \textbf{training-free} method, VLA-IAP (Interaction-Aligned Pruning), introduces a geometric prior mechanism to preserve structural anchors and a dynamic scheduling strategy that adapts pruning intensity based on semantic-motion alignment. This enables a conservative-to-aggressive transition, ensuring robustness during early uncertainty and efficiency once interaction is locked. Extensive experiments show that VLA-IAP achieves a \textbf{97.8\% success rate} with a \textbf{$1.25\times$ speedup} on the LIBERO benchmark, and up to \textbf{$1.54\times$ speedup} while maintaining performance \textbf{comparable to the unpruned backbone}. Moreover, the method demonstrates superior and consistent performance across multiple model architectures and three different simulation environments, as well as a real robot platform, validating its strong generalization capability and practical applicability. Our project website is: \href{https://chengjt1999.github.io/VLA-IAP.github.io/}{VLA-IAP.com}.