arrow
返回

Learning inter-class optical flow difference using generative adversarial networks for facial expression recognition

delete2022-06-17
delete5
delete
OA
AI
W
Wenping Guo
X
Xiaoming Zhao *
S
Shiqing Zhang
X
Xianzhang Pan
DOI:10.1007/s11042-022-13360-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Facial expression recognition is a fine-grained task because different emotions have subtle facial movements. This paper proposes to learn inter-class optical flow difference using generative adversarial networks (GANs) for facial expression recognition. Initially, the proposed method employs a GAN to produce inter-class optical flow images from the difference between the static fully expressive samples and neutral expression samples. Such inter-class optical flow difference is used to highlight the displacement of facial parts between the neutral facial images and fully expressive facial images, which can avoid the disadvantage that the optical flow change between adjacent frames of the same video expression image is not obvious. Then, the proposed method designs four-channel convolutional neural networks (CNNs) to learn high-level optical flow features from the produced inter-class optical flow images, and high-level static appearance features from the fully expressive facial images, respectively. Finally, a decision-level fusion strategy is adopted to implement facial expression classification. The proposed method is validated on two public facial expression databases, BAUM_1a, SAMM and AFEW5.0, demonstrating its promising performance.
Keyword:
Facial expression recognition
Generative adversarial networks
Convolutional neural networks
Optical flow
Inter-class

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

T
taizhou university
学者数:
4.8K
论文数: 3.3K
被引数: 76
引用论文

引用论文

Hierarchical support vector machine for facial micro-expression recognition
err2020-08-21
err20
PREAI
errPan, Hang; Xie, Lun; Lv, Zeping; Li, Juan; Wang, Zhiliang
err分享
err收藏
What Emotion Does the Facial Expression of Disgust Express?厌恶的面部表情表达了什么情绪?
errEMOTION
IF3.6
err2012-01-01
err58
PREAI
errPochedly, Joseph T.; Widen, Sherri C.; Russell, James A.
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Spatial variability of soil nutrients in forest areas: A case study from subtropical China
err2018-09-09
err0
PREAI
errWei Dai; Yuhuan Li; Weijun Fu; Peikun Jiang; Keli Zhao; Yongfu Li; Petri Penttinen
err分享
err收藏
Recognizing Facial Expressions Using a Shallow Convolutional Neural Network
err2019-01-01
err79
errOAAI
errMiao, Si; Xu, Haoyu; Han, Zhenqi; Zhu, Yongxin
err分享
err收藏
学者 查看更多内容