arrow
返回

Facial micro-expression recognition using stochastic graph convolutional network and dual transferred learning

delete2024-10-01
delete2
PRE
AI
H
Hui Tang
L
Li Chai *
DOI:10.1016/j.neunet.2024.106421delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Micro -expression recognition (MER) has drawn increasing attention due to its wide application in lie detection, criminal detection and psychological consultation. However, the best recognition accuracy on recent public dataset is still low compared to the accuracy of macro -expression recognition. In this paper, we propose a novel graph convolution network (GCN) for MER achieving state-of-the-art accuracy. Different to existing GCN with fixed graph structure, we define a stochastic graph structure in which some neighbors are selected randomly. As shown by numerical examples, randomness enables better feature characterization while reducing computational complexity. The whole network consists of two branches, one is the spatial branch taking microexpression images as input, the other is the temporal branch taking optical flow images as input. Because the micro -expression dataset does not have enough images for training the GCN, we employ the transfer learning mechanism. That is, different stochastic GCNs (SGCN) have been trained by the macro -expression dataset in the source network. Then the well -trained SGCNs are transferred to the target network. It is shown that our proposed method achieves the state -of -art performance on all four well-known datasets. This paper explores stochastic GCN and transfer learning with this random structure in the MER task, which is of great importance to improve the recognition performance.
Keyword:
Micro-expression recognition
Graph convolutional network
Transfer learning
Optical flow

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods
err2018-10-01
err147
errOAAI
errLi, Xiaobai; Hong, Xiaopeng; Moilanen, Antti; Huang, Xiaohua; Pfister, Tomas; Zhao, Guoying; Pietikainen, Matti
err分享
err收藏
Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized Patterns
err2016-01-01
err215
PREAI
errHuang, Xiaohua; Zhao, Guoying; Hong, Xiaopeng; Zheng, Wenming; Pietikainen, Matti
err分享
err收藏
Multi-task mid-level feature learning for micro-expression recognition
err2017-06-01
err43
PREAI
errHe, Jiachi; Hu, Jian-Fang; Lu, Xi; Zheng, Wei-Shi
err分享
err收藏
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition
err2016-10-01
err329
PREAI
errLiu, Yong-Jin; Zhang, Jin-Kai; Yan, Wen-Jing; Wang, Su-Jing; Zhao, Guoying; Fu, Xiaolan
err分享
err收藏
Vasopressin modulates the activity of catecholamine containing neurons in specific brain regions
err1979-01-01
err0
PREAI
errDirk H.G. Versteeg; E.Ronald De Kloet; Tjeerd Van Wimersma Greidanus; David De Wied
err分享
err收藏
学者 查看更多内容