RewardFlow: Generate Images by Optimizing What You Reward
AI 摘要
RewardFlow通过优化奖励函数,引导预训练扩散模型生成图像,实现高质量图像编辑和生成。
主要贡献
- 提出RewardFlow框架,通过多奖励Langevin动力学引导图像生成。
- 引入基于VQA的可微分奖励,提供细粒度的语义监督。
- 设计prompt-aware自适应策略,动态调整奖励权重和步长。
方法论
通过设计多个可微奖励函数和自适应策略,在推理时引导预训练模型生成符合要求的图像。
原文摘要
We introduce RewardFlow, an inversion-free framework that steers pretrained diffusion and flow-matching models at inference time through multi-reward Langevin dynamics. RewardFlow unifies complementary differentiable rewards for semantic alignment, perceptual fidelity, localized grounding, object consistency, and human preference, and further introduces a differentiable VQA-based reward that provides fine-grained semantic supervision through language-vision reasoning. To coordinate these heterogeneous objectives, we design a prompt-aware adaptive policy that extracts semantic primitives from the instruction, infers edit intent, and dynamically modulates reward weights and step sizes throughout sampling. Across several image editing and compositional generation benchmarks, RewardFlow delivers state-of-the-art edit fidelity and compositional alignment.