Beyond Paper-to-Paper: Structured Profiling and Rubric Scoring for Paper-Reviewer Matching
AI 摘要
P2R框架利用LLM构建论文和评审人结构化 профили,进行精准高效的评审匹配。
主要贡献
- 提出P2R框架,从paper-to-paper匹配转向基于结构化 профили的匹配。
- 利用LLM构建论文和评审人关于Topics、Methodologies和Applications的结构化 профили。
- 提出coarse-to-fine的匹配流程,兼顾效率和深度。
方法论
使用LLM提取论文和评审者的主题、方法和应用,构建结构化 профили。采用混合检索生成候选集,并通过LLM评估委员会进行评分。
原文摘要
As conference submission volumes continue to grow, accurately recommending suitable reviewers has become a challenge. Most existing methods follow a ``Paper-to-Paper'' matching paradigm, implicitly representing a reviewer by their publication history. However, effective reviewer matching requires capturing multi-dimensional expertise, and textual similarity to past papers alone is often insufficient. To address this gap, we propose P2R, a training-free framework that shifts from implicit paper-to-paper matching to explicit profile-based matching. P2R uses general-purpose LLMs to construct structured profiles for both submissions and reviewers, disentangling them into Topics, Methodologies, and Applications. Building on these profiles, P2R adopts a coarse-to-fine pipeline to balance efficiency and depth. It first performs hybrid retrieval that combines semantic and aspect-level signals to form a high-recall candidate pool, and then applies an LLM-based committee to evaluate candidates under strict rubrics, integrating both multi-dimensional expert views and a holistic Area Chair perspective. Experiments on NeurIPS, SIGIR, and SciRepEval show that P2R consistently outperforms state-of-the-art baselines. Ablation studies further verify the necessity of each component. Overall, P2R highlights the value of explicit, structured expertise modeling and offers practical guidance for applying LLMs to reviewer matching.