Multimodal Learning 相关度: 9/10

Zero-Shot Retail Theft Detection via Orchestrated Vision Models: A Model-Agnostic, Cost-Effective Alternative to Trained Single-Model Systems

Haileab Yagersew
arXiv: 2604.14846v1 发布: 2026-04-16 更新: 2026-04-16

AI 摘要

Paza是一个零样本零售盗窃检测框架,利用多模型协同降低成本,保护隐私。

主要贡献

  • 提出了一种零样本零售盗窃检测框架Paza,无需训练模型。
  • 利用多模型协同降低了VLM的调用频率,降低了成本。
  • 设计了隐私保护机制,在检测过程中模糊人脸。

方法论

通过低成本的目标检测和姿态估计进行预过滤,仅在触发时调用昂贵的视觉-语言模型。

原文摘要

Retail theft costs the global economy over \$100 billion annually, yet existing AI-based detection systems require expensive custom model training on proprietary datasets and charge \$200-500/month per store. We present Paza, a zero-shot retail theft detection framework that achieves practical concealment detection without training any model. Our approach orchestrates multiple existing models in a layered pipeline - cheap object detection and pose estimation running continuously, with an expensive vision-language model (VLM) invoked only when behavioral pre-filters trigger. A multi-signal suspicion pre-filter (requiring dwell time plus at least one behavioral signal) reduces VLM invocations by 240x compared to per-frame analysis, bounding calls to <=10/minute and enabling a single GPU to serve 10-20 stores. The architecture is model-agnostic: the VLM component accepts any OpenAI-compatible endpoint, enabling operators to swap between models such as Gemma 4, Qwen3.5-Omni, GPT-4o, or future releases without code changes - ensuring the system improves as the VLM landscape evolves. We evaluate the VLM component on the DCSASS synthesized shoplifting dataset (169 clips, controlled environment), achieving 89.5% precision and 92.8% specificity at 59.3% recall zero-shot - where the recall gap is attributable to sparse frame sampling in offline evaluation rather than VLM reasoning failures, as precision and specificity are the operationally critical metrics determining false alarm rates. We present a detailed cost model showing viability at \$50-100/month per store (3-10x cheaper than commercial alternatives), and introduce a privacy-preserving design that obfuscates faces in the detection pipeline. The source code is available at https://github.com/xHaileab/Paza-AI.

标签

零样本学习 零售盗窃检测 多模态学习 隐私保护

arXiv 分类

cs.CV cs.AI