AI Agents 相关度: 8/10

MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generation

Yan Li, Zezi Zeng, Yifan Yang, Yuqing Yang, Ning Liao, Weiwei Guo, Lili Qiu, Mingxi Cheng, Qi Dai, Zhendong Wang, Zhengyuan Yang, Xue Yang, Ji Li, Lijuan Wang, Chong Luo
arXiv: 2604.15309v1 发布: 2026-04-16 更新: 2026-04-16

AI 摘要

MM-WebAgent是一个用于多模态网页生成的分层代理框架,通过规划和自反思协调AIGC工具。

主要贡献

  • 提出MM-WebAgent框架,用于多模态网页生成
  • 引入多模态网页生成基准
  • 提出多层次评估协议

方法论

提出分层代理框架,通过分层规划和迭代自反思协调AIGC元素生成,优化全局布局、局部内容及其集成。

原文摘要

The rapid progress of Artificial Intelligence Generated Content (AIGC) tools enables images, videos, and visualizations to be created on demand for webpage design, offering a flexible and increasingly adopted paradigm for modern UI/UX. However, directly integrating such tools into automated webpage generation often leads to style inconsistency and poor global coherence, as elements are generated in isolation. We propose MM-WebAgent, a hierarchical agentic framework for multimodal webpage generation that coordinates AIGC-based element generation through hierarchical planning and iterative self-reflection. MM-WebAgent jointly optimizes global layout, local multimodal content, and their integration, producing coherent and visually consistent webpages. We further introduce a benchmark for multimodal webpage generation and a multi-level evaluation protocol for systematic assessment. Experiments demonstrate that MM-WebAgent outperforms code-generation and agent-based baselines, especially on multimodal element generation and integration. Code & Data: https://aka.ms/mm-webagent.

标签

多模态学习 AI Agents 网页生成

arXiv 分类

cs.CV cs.AI cs.CL