arrow
返回

Implicit space pose consistent transfer network for deep face verification

delete2023-12-01
delete0
PRE
AI
K
Kangli Zeng
王
王中元 (Zhongyuan Wang) *
T
Tao Lü
J
Jianyu Chen
Z
Zhen Han
DOI:10.1016/j.patrec.2023.10.017delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unconstrained face recognition has achieved state-of-the-art performance with the help of the powerful representation capabilities of deep convolutional neural networks. However, face recognition always suffers from other intra-class imbalances due to the influence of pose variations present in the real world, which significantly degrades the performance, especially for tilted face recognition under surveillance videos, which is rarely studied. Tilted face recognition is more challenging than frontal and profile face recognition due to the effect of self-obscuration. To this end, we consider promoting the frontalization of tilted faces in the implicit space, while preserving identity information. In this paper, we propose an implicit spatial pose consistent transfer network (PCTN) that exploits the prior guidance of pose information to enhance the model's ability to perceive pose. Specifically, we first develop the multi-path attention block (MPAB), which is used as the main block for feature embedding in deep networks. Such a design is employed to enhance the relevance of multi-layer convolutional features and provide a powerful foundation for the deep asymptotic transfer of feature frontalization. Then, the pose consistent transfer module (PCTM) combines pose labels and deep embedding features to learn robust discriminative information. PCTM consists of two parts: the pose guidance block (PGB) explores the implicit nonlinear feature mapping from pose faces to frontal faces in feature space, and the attention compensation module (ACM) aims to exploit the complementarity of dense and sparse features, enhancing pose-related features and suppressing pose-unrelated features in terms of both spatial-wise and channel-wise. Furthermore, we investigate the performance comparison on datasets with multiple pose variations without performance degradation. Extensive experimental results on multiple benchmark datasets demonstrate the effectiveness of our proposed method.
Keyword:
Face recognition
Pose consistency
Frontalization
Attention mechanism

期刊

Pattern Recognition Letters 封面图
Pattern Recognition Letters
IF:
3.3
论文数:
8.0K
被引数:
1.6W

机构

W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
W
wuhan institute of technology
学者数:
1.0W
论文数: 6.6K
被引数: 11
引用论文

引用论文

Client ahead‐of‐time compiler for embedded Java platforms
err2008-08-05
err0
PREAI
errSunghyun Hong; Jin‐Chul Kim; Soo‐Mook Moon; Jin Woo Shin; Jaemok Lee; Hyeong‐Seok Oh; Hyung‐Kyu Choi
err分享
err收藏
Core–Shell Catalyst CuO–ZnO–Al2O3@Al2O3 for Dimethyl Ether Synthesis from Syngas
err2013-04-05
err0
PREAI
errYan Wang; Wenli Wang; Yuexian Chen; Jinghong Ma; Jiajun Zheng; Ruifeng Li
err分享
err收藏
Pathological Features and Clinical Course in Patients With Recurrent or Malignant Orbital Solitary Fibrous Tumor/Hemangiopericytoma
err2019-03-01
err0
PREAI
errOded Sagiv; Diana Bell; Yunxia Guo; Shirley Su; Sara T. Wester; Kailun Jiang; Vivian T. Yin; Roman Shinder; Brent Hayek; Hee Joon Kim; Michael T. Tetzlaff; Bita Esmaeli
err分享
err收藏
Requirement for Croquemort in Phagocytosis of Apoptotic Cells in Drosophila
err1999-06-18
err0
PREAI
errNathalie C. Franc; Pascal Heitzler; R. Alan B.; Ezekowitz; Kristin White
err分享
err收藏
Mapping snow depth within a tundra ecosystem using multiscale observations and Bayesian methods
err2017-04-03
err0
errOAAI
errHaruko M. Wainwright; Anna K. Liljedahl; Baptiste Dafflon; Craig Ulrich; John E. Peterson; Alessio Gusmeroli; Susan S. Hubbard
err分享
err收藏
Individual distance in two species of macaque
err1964-04-01
err0
PREAI
errLeonard A. Rosenblum; I.Charles Kaufman; A.J. Stynes
err分享
err收藏
Two-photon absorption and photoluminescence of colloidal gold nanoparticles and nanoclusters
err2019-01-01
err0
PREAI
errJoanna Olesiak-Banska; Magdalena Waszkielewicz; Patryk Obstarczyk; Marek Samoc
err分享
err收藏
学者 查看更多内容