Categorical Flow Maps
AI 摘要
提出Categorical Flow Maps,加速类别数据的少步生成,实现优异性能。
主要贡献
- 提出Categorical Flow Maps方法
- 基于flow matching的类别数据生成
- 利用自蒸馏加速生成
- 持续轨迹,可使用现有蒸馏技术
方法论
构建从单纯形到预测终点的flow map,利用连续轨迹训练,结合蒸馏技术和终点一致性目标。
原文摘要
We introduce Categorical Flow Maps, a flow-matching method for accelerated few-step generation of categorical data via self-distillation. Building on recent variational formulations of flow matching and the broader trend towards accelerated inference in diffusion and flow-based models, we define a flow map towards the simplex that transports probability mass toward a predicted endpoint, yielding a parametrisation that naturally constrains model predictions. Since our trajectories are continuous rather than discrete, Categorical Flow Maps can be trained with existing distillation techniques, as well as a new objective based on endpoint consistency. This continuous formulation also automatically unlocks test-time inference: we can directly reuse existing guidance and reweighting techniques in the categorical setting to steer sampling toward downstream objectives. Empirically, we achieve state-of-the-art few-step results on images, molecular graphs, and text, with strong performance even in single-step generation.