From Imitation to Discrimination: Progressive Curriculum Learning for Robust Web Navigation
AI 摘要
论文提出Triton数据集和渐进式课程学习,提升Web导航Agent的鲁棒性和泛化能力。
主要贡献
- Triton数据集:包含590k实例,通过难负例挖掘构建
- 渐进式课程学习:包含模仿、判别和长时一致性三个阶段
- Triton-GRPO-32B模型:在Mind2Web上取得SOTA性能
方法论
通过结构语义难负例挖掘和双Agent共识构建数据集,并采用赔率比率和群体相对策略优化进行渐进式训练。
原文摘要
Text-based web agents offer computational efficiency for autonomous web navigation, yet developing robust agents remains challenging due to the noisy and heterogeneous nature of real-world HTML. Standard Supervised Fine-Tuning (SFT) approaches fail in two critical dimensions: they lack discrimination capabilities to reject plausible but incorrect elements in densely populated pages, and exhibit limited generalization to unseen website layouts. To address these challenges, we introduce the Triton dataset (590k instances) and a progressive training curriculum. Triton is constructed via Structural-Semantic Hard Negative Mining, which explicitly mines topologically similar distractors, and a Dual-Agent Consensus pipeline that synthesizes diverse cross-domain tasks with strict verification. Building upon this foundation, our progressive curriculum produces three models: Triton-SFT-32B for basic imitation, Triton-ORPO-32B for robust discrimination via Odds Ratio Preference Optimization, and Triton-GRPO-32B for long-horizon consistency through Group Relative Policy Optimization. Empirical evaluation on Mind2Web demonstrates that Triton-GRPO-32B achieves state-of-the-art performance among open-source models with 58.7% Step Success Rate, surpassing GPT-4.5 (42.4%) and Claude-4.5 (41.4%) by over 16%, validating that specialized data curriculum outweighs raw parameter scale for web navigation.