Multimodal Learning 相关度: 8/10

AnyDoc: Enhancing Document Generation via Large-Scale HTML/CSS Data Synthesis and Height-Aware Reinforcement Optimization

Jiawei Lin, Wanrong Zhu, Vlad I Morariu, Christopher Tensmeyer
arXiv: 2603.25118v1 发布: 2026-03-26 更新: 2026-03-26

AI 摘要

AnyDoc框架通过大规模HTML/CSS数据合成和高度感知强化学习优化文档生成,效果显著。

主要贡献

  • 提出了AnyDoc框架,用于统一处理多种文档生成任务
  • 构建了大规模HTML/CSS文档数据集DocHTML
  • 引入高度感知强化学习(HARL)解决内容溢出问题

方法论

AnyDoc首先合成大量HTML/CSS数据,然后微调多模态大语言模型,最后使用HARL进行后训练优化。

原文摘要

Document generation has gained growing attention in the field of AI-driven content creation. In this work, we push its boundaries by introducing AnyDoc, a framework capable of handling multiple generation tasks across a wide spectrum of document categories, all represented in a unified HTML/CSS format. To overcome the limited coverage and scale of existing human-crafted document datasets, AnyDoc first establishes a scalable data synthesis pipeline to automatically generate documents in HTML/CSS form. This pipeline yields DocHTML, a large-scale dataset containing 265,206 document samples, while spanning 111 categories and 32 distinct styles. Additionally, all documents are equipped with comprehensive metadata, including design intentions, HTML/CSS source code, visual assets, and rendered screenshots. Building on the curated dataset, AnyDoc fine-tunes multi-modal large language models (MLLMs) to achieve three practical document generation tasks: intention-to-document, document derendering, and element-to-document. To address the content overflow issue observed during fine-tuning, AnyDoc further incorporates a height-aware reinforcement learning (HARL) post-training procedure. By defining a reward function based on the difference between predicted and target document heights, overflow is penalized and gradually mitigated during HARL, thereby enhancing overall performance. Qualitative and quantitative experiments demonstrate that AnyDoc outperforms both general-purpose MLLMs and task-specific baselines across all three tasks.

标签

文档生成 HTML/CSS 多模态学习 强化学习 数据合成

arXiv 分类

cs.CV