Agent Tuning & Optimization 相关度: 7/10

GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendation

Yanyan Zou, Junbo Qi, Lunsong Huang, Yu Li, Kewei Xu, Jiabao Gao, Binglei Zhao, Xuanhua Yang, Sulong Xu, Shengjie Li
arXiv: 2604.14878v1 发布: 2026-04-16 更新: 2026-04-16

AI 摘要

GenRec是一个面向偏好的生成式推荐框架,通过优化训练和预填充策略,提升推荐效果。

主要贡献

  • 提出了Page-wise NTP训练任务
  • 使用非对称线性Token Merger压缩长序列
  • 引入GRPO-SR强化学习方法对齐用户偏好

方法论

使用decoder-only架构,结合Page-wise NTP、Token Merger和GRPO-SR,优化生成式推荐模型。

原文摘要

Generative Retrieval (GR) offers a promising paradigm for recommendation through next-token prediction (NTP). However, scaling it to large-scale industrial systems introduces three challenges: (i) within a single request, the identical model inputs may produce inconsistent outputs due to the pagination request mechanism; (ii) the prohibitive cost of encoding long user behavior sequences with multi-token item representations based on semantic IDs, and (iii) aligning the generative policy with nuanced user preference signals. We present GenRec, a preference-oriented generative framework deployed on the JD App that addresses above challenges within a single decoder-only architecture. For training objective, we propose Page-wise NTP task, which supervises over an entire interaction page rather than each interacted item individually, providing denser gradient signal and resolving the one-to-many ambiguity of point-wise training. On the prefilling side, an asymmetric linear Token Merger compresses multi-token Semantic IDs in the prompt while preserving full-resolution decoding, reducing input length by ~2X with negligible accuracy loss. To further align outputs with user satisfaction, we introduce GRPO-SR, a reinforcement learning method that pairs Group Relative Policy Optimization with NLL regularization for training stability, and employs Hybrid Rewards combining a dense reward model with a relevance gate to mitigate reward hacking. In month-long online A/B tests serving production traffic, GenRec achieves 9.5% improvement in click count and 8.7% in transaction count over the existing pipeline.

标签

生成式推荐 序列推荐 强化学习 用户偏好

arXiv 分类

cs.IR cs.AI