Multimodal Learning 相关度: 6/10

Categorical Flow Maps

Daan Roos, Oscar Davis, Floor Eijkelboom, Michael Bronstein, Max Welling, İsmail İlkan Ceylan, Luca Ambrogioni, Jan-Willem van de Meent
arXiv: 2602.12233v1 发布: 2026-02-12 更新: 2026-02-12

AI 摘要

提出Categorical Flow Maps,加速类别数据的少步生成,实现优异性能。

主要贡献

  • 提出Categorical Flow Maps方法
  • 基于flow matching的类别数据生成
  • 利用自蒸馏加速生成
  • 持续轨迹,可使用现有蒸馏技术

方法论

构建从单纯形到预测终点的flow map,利用连续轨迹训练,结合蒸馏技术和终点一致性目标。

原文摘要

We introduce Categorical Flow Maps, a flow-matching method for accelerated few-step generation of categorical data via self-distillation. Building on recent variational formulations of flow matching and the broader trend towards accelerated inference in diffusion and flow-based models, we define a flow map towards the simplex that transports probability mass toward a predicted endpoint, yielding a parametrisation that naturally constrains model predictions. Since our trajectories are continuous rather than discrete, Categorical Flow Maps can be trained with existing distillation techniques, as well as a new objective based on endpoint consistency. This continuous formulation also automatically unlocks test-time inference: we can directly reuse existing guidance and reweighting techniques in the categorical setting to steer sampling toward downstream objectives. Empirically, we achieve state-of-the-art few-step results on images, molecular graphs, and text, with strong performance even in single-step generation.

标签

Flow Matching Self-Distillation Categorical Data Generation Generative Models

arXiv 分类

cs.LG