Agentic Explainability at Scale: Between Corporate Fears and XAI Needs
AI 摘要
针对企业Agentic AI部署的风险,提出了设计时和运行时的可解释性方法,并原型化了Agentic AI卡。
主要贡献
- 识别了企业Agentic AI大规模部署的治理风险
- 提出了设计时和运行时的可解释性技术以应对风险
- 提出了 Agentic AI 卡的概念以提升部署信心
方法论
调研企业AI治理专业人员的担忧,结合AI治理专家的建议,提出了相应的解决方案,并进行了原型验证。
原文摘要
As companies enter the race for agentic AI adoption, fears surface around agentic autonomy and its subsequent risks. These fears compound as companies scale their agentic AI adoption with low-code applications, without a comparable scaling in their governance processes and expertise resulting in a phenomenon known as "Agent Sprawl". While shadow AI tools can help with agentic discovery and identification, few observability tools offer insights into the agents' configuration and settings or the decision-making process during agent-to-agent communication and orchestration. This paper explores AI governance professionals' concerns in enterprise settings, while offering design-time and runtime explainability techniques as suggested by AI governance experts for addressing those fears. Finally, we provide a preliminary prototype of an Agentic AI Card that can help companies feel at ease deploying agents at scale.