arrow
Return

Facial Expression Recognition Using Frequency Neural Network

delete2021-01-01
delete35
PRE
AI
Y
Yan Tang
X
Xingming Zhang *
胡希平 (Xiping Hu) *
S
Siqi Wang *
王昊翔 cover
王昊翔 (Haoxiang Wang)
DOI:10.1109/TIP.2020.3037467delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Facial expression recognition has become a newly-emerging topic in recent decades, which has important value in the field of human-computer interaction. In this paper, we present a deep learning based approach, named frequency neural network (FreNet), for facial expression recognition. Different from convolutional neural network in spatial domain, FreNet inherits the advantages of processing image in frequency domain, such as efficient computation and spatial redundancy elimination. First, we propose the learnable multiplication kernel and construct multiple multiplication layers to learn features in frequency domain. Second, a summarization layer is proposed following multiplication layers to further yield high-level features. Third, based on the property of discrete cosine transform (DCT), we utilize multiplication layers and summarization layer to construct the Basic-FreNet, which can yield high-level features on the widely used DCT feature. Finally, to further achieve better performance on Basic-FreNet, we propose the Block-FreNet in which the weight-shared multiplication kernel is designed for feature learning and the block sub-sampling is designed for dimension reduction. The experimental results show that the Block-FreNet not only achieves superior performance, but also greatly reduces the computational cost. To our best knowledge, the proposed approach is the first attempt to fill in the blank of frequency based deep learning model for facial expression recognition.
Keywords:
Frequency-domain analysis
Feature extraction
Discrete cosine transforms
Face recognition
Deep learning
Neural networks
Facial features
Facial expression recognition
frequency domain analysis
deep learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

S
shenzhen institute of advanced technology, cas
Scholars:
5.6K
Papers: 4.5K
Citations: 7
C
chinese academy of sciences
Scholars:
56.3W
Papers: 44.8W
Citations: 704
S
south china university of technology
Scholars:
6.7W
Papers: 5.1W
Citations: 85
researcher View more organizations