AI Agents 相关度: 9/10

Benchmarks for Trajectory Safety Evaluation and Diagnosis in OpenClaw and Codex: ATBench-Claw and ATBench-CodeX

Zhonghao Yang, Yu Li, Yanxu Zhu, Tianyi Zhou, Yuejin Xie, Haoyu Luo, Jing Shao, Xia Hu, Dongrui Liu
arXiv: 2604.14858v1 发布: 2026-04-16 更新: 2026-04-16

AI 摘要

提出了ATBench-Claw和ATBench-CodeX,扩展了ATBench以评估和诊断OpenClaw和Codex环境下的Agent轨迹安全性。

主要贡献

  • 针对OpenClaw和Codex环境定制了ATBench
  • 定义了适用于特定领域的安全分类法
  • 强调了通用ATBench框架下的风险覆盖和基准设计

方法论

通过分析新环境,定制三维安全分类法,并用其定义基准规范,由共享的ATBench构建管道使用。

原文摘要

As agent systems move into increasingly diverse execution settings, trajectory-level safety evaluation and diagnosis require benchmarks that evolve with them. ATBench is a diverse and realistic agent trajectory benchmark for safety evaluation and diagnosis. This report presents ATBench-Claw and ATBench-CodeX, two domain-customized extensions that carry ATBench into the OpenClaw and OpenAI Codex / Codex-runtime settings. The key adaptation mechanism is to analyze each new setting, customize the three-dimensional Safety Taxonomy over risk source, failure mode, and real-world harm, and then use that customized taxonomy to define the benchmark specification consumed by the shared ATBench construction pipeline. This extensibility matters because agent frameworks remain relatively stable at the architectural level even as their concrete execution settings, tool ecosystems, and product capabilities evolve quickly. Concretely, ATBench-Claw targets OpenClaw-sensitive execution chains over tools, skills, sessions, and external actions, while ATBench-CodeX targets trajectories in the OpenAI Codex / Codex-runtime setting over repositories, shells, patches, dependencies, approvals, and runtime policy boundaries. Our emphasis therefore falls on taxonomy customization, domain-specific risk coverage, and benchmark design under a shared ATBench generation framework.

标签

AI Agents Safety Benchmarking Trajectory Analysis

arXiv 分类

cs.AI cs.SE