arrow
返回

LOTR: Face Landmark Localization Using Localization Transformer

delete2022-01-01
delete9
delete
OA
AI
U
Ukrit Watchareeruetai *
B
Benjaphan Sommana
S
Sanjana Jain
P
Pavit Noinongyao
A
Ankush Ganguly
A
Aubin Samacoïts
S
Samuel W. F. Earp
N
Nakarin Sritrakool
DOI:10.1109/ACCESS.2022.3149380delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper presents a novel Transformer-based facial landmark localization network named Localization Transformer (LOTR). The proposed framework is a direct coordinate regression approach leveraging a Transformer network to better utilize the spatial information in a feature map. An LOTR model consists of three main modules: 1) a visual backbone that converts an input image into a feature map, 2) a Transformer module that improves the feature representation from the visual backbone, and 3) a landmark prediction head that directly predicts landmark coordinates from the Transformer's representation. Given cropped-and-aligned face images, the proposed LOTR can be trained end-to-end without requiring any post-processing steps. This paper also introduces a loss function named smooth-Wing loss, which addresses the gradient discontinuity of the Wing loss, leading to better convergence than standard loss functions such as L1, L2, and Wing loss. Experimental results on the JD landmark dataset provided by the First Grand Challenge of 106-Point Facial Landmark Localization indicate the superiority of LOTR over the existing methods on the leaderboard and two recent heatmap-based approaches. On the WFLW dataset, the proposed LOTR framework demonstrates promising results compared with several state-of-the-art methods. Additionally, we report an improvement in the performance of state-of-the-art face recognition systems when using our proposed LOTRs for face alignment.
Keyword:
Location awareness
Transformers
Heating systems
Face recognition
Faces
Complexity theory
Visualization
Artificial neural networks
computer vision
deep learning
face recognition
image processing
machine learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

C
Chulalongkorn University
学者数:
1.8W
论文数: 1.4W
被引数: 1.5W
引用论文

引用论文

Client ahead‐of‐time compiler for embedded Java platforms
err2008-08-05
err0
PREAI
errSunghyun Hong; Jin‐Chul Kim; Soo‐Mook Moon; Jin Woo Shin; Jaemok Lee; Hyeong‐Seok Oh; Hyung‐Kyu Choi
err分享
err收藏
err分享
err收藏
Breakdown of the Mott-Hubbard State inFe2O3: A First-Order Insulator-Metal Transition with Collapse of Magnetism at 50 GPa
err1999-06-07
err0
PREAI
errM. P. Pasternak; G. Kh. Rozenberg; G. Yu. Machavariani; O. Naaman; R. D. Taylor; R. Jeanloz
err分享
err收藏
Individual distance in two species of macaque
err1964-04-01
err0
PREAI
errLeonard A. Rosenblum; I.Charles Kaufman; A.J. Stynes
err分享
err收藏
学者 查看更多内容