AI Agents 相关度: 10/10

Gym-Anything: Turn any Software into an Agent Environment

Pranjal Aggarwal, Graham Neubig, Sean Welleck
arXiv: 2604.06126v1 发布: 2026-04-07 更新: 2026-04-07

AI 摘要

Gym-Anything框架将任何软件转化为交互式Agent环境,并构建大规模CUA-World基准测试。

主要贡献

  • 提出Gym-Anything框架,实现软件到Agent环境的自动转换
  • 构建CUA-World和CUA-World-Long大规模基准测试集
  • 利用审计机制提升模型在复杂任务中的表现

方法论

使用多Agent架构,一个Agent负责环境搭建和数据配置,另一个Agent负责验证环境的正确性,并构建benchmark。

原文摘要

Computer-use agents hold the promise of assisting in a wide range of digital economic activities. However, current research has largely focused on short-horizon tasks over a limited set of software with limited economic value, such as basic e-commerce and OS-configuration tasks. A key reason is that creating environments for complex software requires significant time and human effort, and therefore does not scale. To address this, we introduce Gym-Anything, a framework for converting any software into an interactive computer-use environment. We frame environment creation itself as a multi-agent task: a coding agent writes setup scripts, downloads real-world data, and configures the software, while producing evidence of correct setup. An independent audit agent then verifies evidence for the environment setup against a quality checklist. Using a taxonomy of economically valuable occupations grounded in U.S. GDP data, we apply this pipeline to 200 software applications with broad occupational coverage. The result is CUA-World, a collection of over 10K long-horizon tasks spanning domains from medical science and astronomy to engineering and enterprise systems, each configured with realistic data along with train and test splits. CUA-World also includes CUA-World-Long, a challenging long-horizon benchmark with tasks often requiring over 500 steps, far exceeding existing benchmarks. Distilling successful trajectories from the training split into a 2B vision-language model outperforms models 2$\times$ its size. We also apply the same auditing principle at test time: a separate VLM reviews completed trajectories and provides feedback on what remains, improving Gemini-3-Flash on CUA-World-Long from 11.5% to 14.0%. We release all code, infrastructure, and benchmark data to facilitate future research in realistic computer-use agents.

标签

AI Agent 环境搭建 基准测试 多Agent系统 VLM

arXiv 分类

cs.LG cs.AI