ToolOmni: Enabling Open-World Tool Use via Agentic learning with Proactive Retrieval and Grounded Execution
AI 摘要
ToolOmni通过主动检索和执行,提升LLM在开放世界中使用工具的能力,显著提高工具检索和执行的成功率。
主要贡献
- 提出了ToolOmni框架,用于开放世界工具使用
- 提出了基于解耦多目标GRPO算法的开放世界工具学习方法
- 构建了冷启动多轮交互数据集用于agentic能力培养
方法论
使用监督微调(SFT)预训练agentic能力,然后通过解耦多目标GRPO算法进行在线环境下的工具检索和执行优化。
原文摘要
Large Language Models (LLMs) enhance their problem-solving capability by utilizing external tools. However, in open-world scenarios with massive and evolving tool repositories, existing methods relying on static embedding retrieval or parameter memorization of tools struggle to align user intent with tool semantics or generalize to unseen tools, respectively, leading to suboptimal accuracy of open-world tool retrieval and execution. To address these, we present ToolOmni, a unified agentic framework that enables LLMs for open-world tool use by proactive retrieval and grounded execution within a reasoning loop. First, we construct a cold-start multi-turn interaction dataset to instill foundational agentic capabilities via Supervised Fine-Tuning (SFT). Then, we introduce open-world tool learning based on a Decoupled Multi-Objective GRPO algorithm, which simultaneously optimizes LLMs for both tool retrieval accuracy and execution efficacy in online environments. Extensive experiments demonstrate that ToolOmni achieves state-of-the-art performance both in retrieval and execution, surpassing strong baselines by a significant margin of +10.8% in end-to-end execution success rate, while exhibiting exceptional robustness and generalization capabilities.