DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment
AI 摘要
DPC-VQA通过解耦感知和校准,高效地将预训练MLLM应用于视频质量评估,降低了训练成本。
主要贡献
- 提出DPC-VQA框架,解耦感知和校准
- 使用冻结MLLM提供感知先验
- 使用轻量校准分支进行目标场景适配
方法论
使用冻结的MLLM提取特征,然后通过轻量级校准分支预测残差,进行视频质量评估。
原文摘要
Recent multimodal large language models (MLLMs) have shown promising performance on video quality assessment (VQA) tasks. However, adapting them to new scenarios remains expensive due to large-scale retraining and costly mean opinion score (MOS) annotations. In this paper, we argue that a pretrained MLLM already provides a useful perceptual prior for VQA, and that the main challenge is to efficiently calibrate this prior to the target MOS space. Based on this insight, we propose DPC-VQA, a decoupling perception and calibration framework for video quality assessment. Specifically, DPC-VQA uses a frozen MLLM to provide a base quality estimate and perceptual prior, and employs a lightweight calibration branch to predict a residual correction for target-scenario adaptation. This design avoids costly end-to-end retraining while maintaining reliable performance with lower training and data costs. Extensive experiments on both user-generated content (UGC) and AI-generated content (AIGC) benchmarks show that DPC-VQA achieves competitive performance against representative baselines, while using less than 2% of the trainable parameters of conventional MLLM-based VQA methods and remaining effective with only 20\% of MOS labels. The code will be released upon publication.