arrow
Return

Quality-aware face alignment using high-resolution spatial dependencies

delete2023-10-16
delete1
PRE
AI
X
Xuefei Li
J
Jing Li *
万军 cover
万军 (Jun Wan)
T
Tong Liu
G
Guohao Li
DOI:10.1007/s11042-023-17295-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Although CNN-based face alignment algorithms have got promising results. However, their alignment accuracy are still suffer from faces with severe occlusions and large poses, which mainly because (1) the inability to model long-range dependencies, construct effective face shape constraints and (2) the limitation on the size of the labeled facial datasets. To address the above problems, this study proposed a transformer-based data distillation semi-supervised face alignment algorithm. The transformer-based heatmap detection network introduces the transformer to model more efficient face shape constraint relationships, thus improving algorithm robustness under partial occlusion. Moreover, a quality-aware pseudolabeled sample distillation network is designed to help transformer obtain the CNNs inherent inductive biases by evaluating the quality of pseudolabeled data generated by transformer-based heatmap detection networks. This study also proposed intensive training strategy to use more unlabeled data without the need for manual operation to further improve the performance of transformer thermal map detection networks. Experimental results on the 300W, AFLW, and 300VW datasets demonstrate the superiority of our method over state-of-the-art face alignment methods.
Keywords:
Face alignment
Transformer
Semi-supervised learning
Heatmap detection
Knowledge distillation

Journal

Multimedia Tools and Applications cover
Multimedia Tools and Applications
IF:
3
Papers:
1.9W
Citations:
3.2W

Organization

Z
zhongnan university of economics & law
Scholars:
2.0K
Papers: 2.2K
Citations: 3
W
wuhan university
Scholars:
8.0W
Papers: 5.8W
Citations: 70