arrow
返回

Confusable facial expression recognition with geometry-aware conditional network

delete2024-04-01
delete2
PRE
AI
T
Tong Liu
J
Jing Li *
Jia Wu 封面图
Jia Wu (Jia Wu)
B
Bo Du
万军 封面图
万军 (Jun Wan)
常军 封面图
常军 (Jun Chang)
DOI:10.1016/j.patcog.2023.110174delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Many facial expression recognition (FER) methods have now achieved satisfactory results. However, some facial expressions have similar muscle deformation, making them easy to confuse. These confusable facial expressions are a key challenge to accurately recognizing facial expressions. In addition, most current FER methods rely on the convolution operation, but convolution is a building block that processes one local neighborhood at a time; thus, it fails to capture the geometric patterns that are important for facial muscle deformation. To address this issue, considering the problems of pose variations and insufficient training data, this paper proposes a geometry-aware conditional network (GACN) that captures long-range dependencies for simultaneous pose-invariant facial expression editing and geometry-aware FER. Specifically, the GACN can complete a pose-invariant image editing task with long-range dependency by introducing conditional self attention operations to a generative adversarial network. Moreover, the GACN presents non-local operations as building blocks of the classifier to capture the texture and geometry patterns simultaneously. Finally, these two tasks can further boost each other's performances through our GACN, and confusable facial expressions can be effectively distinguished. And we overcome the effect of pose variations while expanding and enriching the training set. Our proposed algorithm is evaluated on both the in-the-lab and in-the-wild datasets and outperforms the state-of-the-art methods.
Keyword:
Confusable facial expression recognition
Facial image synthesis
Long-range dependencies
Geometry-aware conditional network

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

Z
zhongnan university of economics & law
学者数:
2.0K
论文数: 2.2K
被引数: 3
M
Macquarie University
学者数:
1.2W
论文数: 1.5W
被引数: 2.2W
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
学者 查看更多机构
引用论文

引用论文

Pathological Features and Clinical Course in Patients With Recurrent or Malignant Orbital Solitary Fibrous Tumor/Hemangiopericytoma
err2019-03-01
err0
PREAI
errOded Sagiv; Diana Bell; Yunxia Guo; Shirley Su; Sara T. Wester; Kailun Jiang; Vivian T. Yin; Roman Shinder; Brent Hayek; Hee Joon Kim; Michael T. Tetzlaff; Bita Esmaeli
err分享
err收藏
err分享
err收藏
Quasiparticle Evidence for the Nematic State above Tc in SrxBi2Se3
err2019-07-10
err0
errOAAI
errYue Sun; Shunichiro Kittaka; Toshiro Sakakibara; Kazushige Machida; Jinghui Wang; Jinsheng Wen; Xiangzhuo Xing; Zhixiang Shi; Tsuyoshi Tamegai
err分享
err收藏
err分享
err收藏
Antineoplastic drug occupational exposure: a new integrated approach to evaluate exposure and early genotoxic and cytotoxic effects by no-invasive Buccal Micronucleus Cytome Assay biomarker
err2019-11-01
err0
errOAAI
errC.L. Ursini; E. Omodeo Salè; A.M. Fresegna; A. Ciervo; C. Jemos; R. Maiello; G. Buresti; C. Colosio; F.M. Rubino; Stefan Mandić-Rajčević; P. Chiarella; D. Carbonari; P. Delrio; P. Maiolino; P. Marchetti; R. Boccia; S. Iavicoli; D. Cavallo
err分享
err收藏
3D Graphene for High-Performance Supercapacitors
err2023-07-21
err0
PREAI
errK. A. U. Madhushani; Ram K. Gupta
err分享
err收藏
A comprehensive serum lipidome profiling of amyotrophic lateral sclerosis
err2020-02-28
err0
PREAI
errGorka FernÁndez-Eulate; JosÉ Ignacio Ruiz-Sanz; Javier Riancho; Monica ZufirÍa; Gorka GereÑu; Roberto FernÁndez-TorrÓn; Juan JosÉ Poza-Aldea; Jon Ondaro; Juan Bautista Espinal; Gonzalo GonzÁlez-ChinchÓn; Miren Zulaica; Maria BegoÑa Ruiz-Larrea; Adolfo LÓpez De Munain; Francisco Javier Gil-Bea
err分享
err收藏
学者 查看更多内容