CuraLight: Debate-Guided Data Curation for LLM-Centered Traffic Signal Control
AI 摘要
CuraLight利用RL辅助LLM进行交通信号控制,通过辩论式数据清洗提升性能。
主要贡献
- 提出CuraLight框架,结合RL和LLM进行交通信号控制
- 利用RL生成高质量的交互轨迹,用于LLM的模仿微调
- 引入多LLM辩论系统评估信号时序动作,提供监督信号
方法论
结合RL探索环境生成数据,转换为prompt-response对微调LLM,使用多LLM辩论系统进行数据清洗。
原文摘要
Traffic signal control (TSC) is a core component of intelligent transportation systems (ITS), aiming to reduce congestion, emissions, and travel time. Recent approaches based on reinforcement learning (RL) and large language models (LLMs) have improved adaptivity, but still suffer from limited interpretability, insufficient interaction data, and weak generalization to heterogeneous intersections. This paper proposes CuraLight, an LLM-centered framework where an RL agent assists the fine-tuning of an LLM-based traffic signal controller. The RL agent explores traffic environments and generates high-quality interaction trajectories, which are converted into prompt-response pairs for imitation fine-tuning. A multi-LLM ensemble deliberation system further evaluates candidate signal timing actions through structured debate, providing preference-aware supervision signals for training. Experiments conducted in SUMO across heterogeneous real-world networks from Jinan, Hangzhou, and Yizhuang demonstrate that CuraLight consistently outperforms state-of-the-art baselines, reducing average travel time by 5.34 percent, average queue length by 5.14 percent, and average waiting time by 7.02 percent. The results highlight the effectiveness of combining RL-assisted exploration with deliberation-based data curation for scalable and interpretable traffic signal control.