Multimodal Learning 相关度: 7/10

Are Face Embeddings Compatible Across Deep Neural Network Models?

Fizza Rubab, Yiying Tong, Arun Ross
arXiv: 2604.07282v1 发布: 2026-04-08 更新: 2026-04-08

AI 摘要

研究不同深度学习模型人脸嵌入的兼容性,发现线性映射可显著提升跨模型人脸识别。

主要贡献

  • 发现不同DNN模型编码人脸身份具有跨模型兼容性
  • 提出使用简单的仿射变换对齐不同模型的人脸表示
  • 揭示了模型家族之间人脸身份编码表示的收敛现象

方法论

通过分析不同DNN模型嵌入空间的几何结构,研究仿射变换对齐人脸表示的效果。

原文摘要

Automated face recognition has made rapid strides over the past decade due to the unprecedented rise of deep neural network (DNN) models that can be trained for domain-specific tasks. At the same time, foundation models that are pretrained on broad vision or vision-language tasks have shown impressive generalization across diverse domains, including biometrics. This raises an important question: Do different DNN models--both domain-specific and foundation models--encode facial identity in similar ways, despite being trained on different datasets, loss functions, and architectures? In this regard, we directly analyze the geometric structure of embedding spaces imputed by different DNN models. Treating embeddings of face images as point clouds, we study whether simple affine transformations can align face representations of one model with another. Our findings reveal surprising cross-model compatibility: low-capacity linear mappings substantially improve cross-model face recognition over unaligned baselines for both face identification and verification tasks. Alignment patterns generalize across datasets and vary systematically across model families, indicating representational convergence in facial identity encoding. These findings have implications for model interoperability, ensemble design, and biometric template security.

标签

人脸识别 深度学习 嵌入空间 模型兼容性

arXiv 分类

cs.CV cs.LG