WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agents
AI 摘要
WebFactory自动化压缩LLM知识到Web代理,高效生成GUI代理数据,提升泛化能力。
主要贡献
- 提出了WebFactory,一个全自动闭环强化学习GUI代理训练流水线。
- 利用合成数据训练的代理性能媲美甚至超过使用人工标注数据训练的代理。
- 对不同LLM的“具身潜力”进行了评估,为模型评估提供新维度。
方法论
通过环境合成、知识感知任务生成、LLM轨迹收集、分解奖励RL训练和系统评估等步骤实现。
原文摘要
Current paradigms for training GUI agents are fundamentally limited by a reliance on either unsafe, non-reproducible live web interactions or costly, scarce human-crafted data and environments. We argue this focus on data volume overlooks a more critical factor: the efficiency of compressing a large language model's (LLM) latent knowledge into actionable agent behavior. We introduce WebFactory, a novel, fully automated closed-loop reinforcement learning pipeline for GUI agents, systematically compressing LLM-encoded internet intelligence into efficient, grounded actions. Our pipeline features a process of scalable environment synthesis, knowledge-aware task generation, LLM-powered trajectory collection, decomposed reward RL training, and systematic agent evaluation. Remarkably, our agent demonstrates exceptional data efficiency and generalization. Trained on synthetic data from only 10 websites within WebFactory, it achieves performance comparable to GUI agents trained on the same amount of human-annotated data from a much larger set of environments. This superior performance is consistent across our internal offline and online transfer benchmarks, where our agent also significantly outperforms the base foundation model. We further provide critical insights into the "embodiment potential" of different LLM foundations, offering a new axis for model evaluation. This work presents a scalable and cost-effective paradigm for transforming passive internet knowledge into active, grounded intelligence, marking a critical step towards general-purpose interactive agents.