Multimodal Learning 相关度: 7/10

Traffic Sign Recognition in Autonomous Driving: Dataset, Benchmark, and Field Experiment

Guoyang Zhao, Weiqing Qi, Kai Zhang, Chenguang Zhang, Zeying Gong, Zhihai Bi, Kai Chen, Benshan Ma, Ming Liu, Jun Ma
arXiv: 2603.23034v1 发布: 2026-03-24 更新: 2026-03-24

AI 摘要

论文提出了大规模交通标志数据集TS-1M,并针对自动驾驶中的鲁棒性问题进行了基准测试。

主要贡献

  • 构建大规模、多样化的交通标志数据集TS-1M
  • 设计诊断性基准测试,评估模型在各种挑战下的性能
  • 分析不同学习范式(监督学习、自监督学习、多模态学习)在交通标志识别上的表现

方法论

论文通过构建数据集和设计benchmark,对不同模型在多种挑战性场景下的性能进行评估和分析,并进行实地实验验证。

原文摘要

Traffic Sign Recognition (TSR) is a core perception capability for autonomous driving, where robustness to cross-region variation, long-tailed categories, and semantic ambiguity is essential for reliable real-world deployment. Despite steady progress in recognition accuracy, existing traffic sign datasets and benchmarks offer limited diagnostic insight into how different modeling paradigms behave under these practical challenges. We present TS-1M, a large-scale and globally diverse traffic sign dataset comprising over one million real-world images across 454 standardized categories, together with a diagnostic benchmark designed to analyze model capability boundaries. Beyond standard train-test evaluation, we provide a suite of challenge-oriented settings, including cross-region recognition, rare-class identification, low-clarity robustness, and semantic text understanding, enabling systematic and fine-grained assessment of modern TSR models. Using TS-1M, we conduct a unified benchmark across three representative learning paradigms: classical supervised models, self-supervised pretrained models, and multimodal vision-language models (VLMs). Our analysis reveals consistent paradigm-dependent behaviors, showing that semantic alignment is a key factor for cross-region generalization and rare-category recognition, while purely visual models remain sensitive to appearance shift and data imbalance. Finally, we validate the practical relevance of TS-1M through real-scene autonomous driving experiments, where traffic sign recognition is integrated with semantic reasoning and spatial localization to support map-level decision constraints. Overall, TS-1M establishes a reference-level diagnostic benchmark for TSR and provides principled insights into robust and semantic-aware traffic sign perception. Project page: https://guoyangzhao.github.io/projects/ts1m.

标签

交通标志识别 自动驾驶 数据集 Benchmark 多模态学习

arXiv 分类

cs.CV