AI Agents 相关度: 8/10

MUSE: Multi-Domain Chinese User Simulation via Self-Evolving Profiles and Rubric-Guided Alignment

Zihao Liu, Hantao Zhou, Jiguo Li, Jun Xu, Jiuchong Gao, Jinghua Hao, Renqing He, Peng Wang
arXiv: 2604.13828v1 发布: 2026-04-15 更新: 2026-04-15

AI 摘要

MUSE提出了一个多领域中文用户模拟框架,提升了对话的真实性、连贯性和一致性。

主要贡献

  • Iterative Profile Self-Evolution (IPSE)优化用户画像
  • Role-Reversal Supervised Fine-Tuning提升局部响应真实性
  • Rubric-guided reinforcement learning增强长期行为一致性

方法论

通过IPSE优化用户画像,Role-Reversal监督微调提升真实性,结合Rubric-guided强化学习保证长期一致性。

原文摘要

User simulators are essential for the scalable training and evaluation of interactive AI systems. However, existing approaches often rely on shallow user profiling, struggle to maintain persona consistency over long interactions, and are largely limited to English or single-domain settings. We present MUSE, a multi-domain Chinese user simulation framework designed to generate human-like, controllable, and behaviorally consistent responses. First, we propose Iterative Profile Self-Evolution (IPSE), which gradually optimizes user profiles by comparing and reasoning discrepancies between simulated trajectories and real dialogue behaviors. We then apply Role-Reversal Supervised Fine-Tuning to improve local response realism and human-like expression. To enable fine-grained behavioral alignment, we further train a specialized rubric-based reward model and incorporate it into rubric-guided multi-turn reinforcement learning, which optimizes the simulator at the dialogue level and enhances long-horizon behavioral consistency. Experiments show that MUSE consistently outperforms strong baselines in both utterance-level and session-level evaluations, generating responses that are more realistic, coherent, and persona-consistent over extended interactions.

标签

用户模拟 多领域 中文 强化学习 对话系统

arXiv 分类

cs.CL