UniPAR: A Unified Framework for Pedestrian Attribute Recognition
AI 摘要
UniPAR提出了一个统一的Transformer框架,用于处理多种模态下的行人属性识别任务。
主要贡献
- 提出了统一的Transformer框架UniPAR用于PAR
- 引入统一数据调度策略和动态分类头
- 设计了分阶段融合编码器,对齐视觉特征和文本属性查询
方法论
UniPAR基于Transformer,通过统一的数据调度、动态分类头和分阶段融合编码器,实现多模态数据的行人属性识别。
原文摘要
Pedestrian Attribute Recognition is a foundational computer vision task that provides essential support for downstream applications, including person retrieval in video surveillance and intelligent retail analytics. However, existing research is frequently constrained by the ``one-model-per-dataset" paradigm and struggles to handle significant discrepancies across domains in terms of modalities, attribute definitions, and environmental scenarios. To address these challenges, we propose UniPAR, a unified Transformer-based framework for PAR. By incorporating a unified data scheduling strategy and a dynamic classification head, UniPAR enables a single model to simultaneously process diverse datasets from heterogeneous modalities, including RGB images, video sequences, and event streams. We also introduce an innovative phased fusion encoder that explicitly aligns visual features with textual attribute queries through a late deep fusion strategy. Experimental results on the widely used benchmark datasets, including MSP60K, DukeMTMC, and EventPAR, demonstrate that UniPAR achieves performance comparable to specialized SOTA methods. Furthermore, multi-dataset joint training significantly enhances the model's cross-domain generalization and recognition robustness in extreme environments characterized by low light and motion blur. The source code of this paper will be released on https://github.com/Event-AHU/OpenPAR