arrow
Return

Relation-Aware Facial Expression Recognition

delete2022-09-01
delete30
PRE
AI
Y
Yifan Xia
H
Hui Yu *
王晓 (Xiao Wang)
M
Muwei Jian
F
Fei‐Yue Wang *
DOI:10.1109/TCDS.2021.3100131delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Research on facial expression recognition has been moving from the constrained lab scenarios to the in-the-wild situations and has made progress in recent years. However, it is still very challenging to deal with facial expression in the wild due to large poses and occlusion as well as illumination and intensity variations. Generally, existing methods mainly take the whole face as a uniform source of features for facial expression analysis. Actually, physiology and psychology research shows that some crucial regions, such as the eye and mouth, reflect the differences of different facial expressions, which have close relationships with emotion expression. Inspired by this observation, a novel relation-aware facial expression recognition method called relation convolutional neural network (ReCNN) is proposed in this article, which can adaptively capture the relationship between crucial regions and facial expressions leading to the focus on the most discriminative regions for recognition. We have evaluated the proposed ReCNN on two large in-the-wild databases: 1) AffectNet and 2) RAF-DB. Extensive experiments on these databases show that our method has superior recognition accuracy compared with state-of-the-art methods and the relationship between crucial regions and facial expressions is beneficial to improve the performance of facial expression recognition.
Keywords:
Face recognition
Feature extraction
Mouth
Image recognition
Deep learning
Databases
Convolutional neural networks
Deep convolutional neural networks
facial expression in the wild
facial expression recognition
relation convolutional neural network (ReCNN)
relation-aware

Journal

IEEE Transactions on Cognitive and Developmental Systems cover
IEEE Transactions on Cognitive and Developmental Systems
IF:
4.9
Papers:
1.0K
Citations:
3.5K

Organization

U
University of Portsmouth
Scholars:
5.1K
Papers: 5.5K
Citations: 9.2K
C
chinese academy of sciences
Scholars:
56.5W
Papers: 44.9W
Citations: 704