arrow
Return

Parallel Spatiotemporal Network to recognize micro-expression

delete2025-07-01
delete0
PRE
AI
J
Jingting Li
S
Sujing Wang *
王
王永 (Yong Wang)
H
Haoliang Zhou
X
Xiaolan Fu
DOI:10.1016/j.neucom.2025.129891delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Micro-expressions are fleeting spontaneous facial expressions that commonly occur in high-stakes scenarios and reflect humans' mental states. Thus, it is one of the crucial clues for lie detection. Furthermore, due to the brief duration of micro-expression, temporal information is important for micro-expression recognition. The paper proposes a Parallel Spatiotemporal Network (PSN) to recognize micro-expression. The proposed PSN includes a spatial sub-network and a temporal sub-network. The spatial sub-network is a shallow network with subtle motion information as the input. And the temporal sub-network is a network with a novel temporal feature extraction unit that extracts sparse temporal features of micro-expressions. Finally, we propose an element- wise addition with 1 x 1 convolutional kernel fusion model to fuse the spatial and temporal features. The proposed PSN gets better measurement metrics (such as recognition rate, F1 score, true positive rate, and true negative rate) than the other state-of-the-art methods on the consisted databases consisting of CASME, CASME II, CAS(ME)2, and SAMM.
Keywords:
Micro-expression recognition
Deep learning
Sparse features
Affective analysis
Lie detection

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

X
Xi'an Jiaotong University
Scholars:
1.2W
Papers: 4.4K
Citations: 8.4W
T
Tianjin Univ Technol
Scholars:
849
Papers: 311
Citations: 115
Cited Papers

Cited Papers

Micro-expression action unit detection with spatial and channel attention
err2021-05-01
err32
errOAAI
errLi, Yante; Huang, Xiaohua; Zhao, Guoying
errShare
errSave
Objective Classes for Micro-Facial Expression Recognition
err2018-10-15
err0
errOAAI
errAdrian K. Davison; Walied Merghani; Moi Hoon Yap
errShare
errSave
Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized Patterns
err2016-01-01
err215
PREAI
errHuang, Xiaohua; Zhao, Guoying; Hong, Xiaopeng; Zheng, Wenming; Pietikainen, Matti
errShare
errSave
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition
err2016-10-01
err329
PREAI
errLiu, Yong-Jin; Zhang, Jin-Kai; Yan, Wen-Jing; Wang, Su-Jing; Zhao, Guoying; Fu, Xiaolan
errShare
errSave
errShare
errSave
Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-Expressions
err2020-03-01
err150
errOAAI
errXia, Zhaoqiang; Hong, Xiaopeng; Gao, Xingyu; Feng, Xiaoyi; Zhao, Guoying
errShare
errSave
researcher View more