arrow
Return

Parallel Spatiotemporal Network to recognize micro-expression

delete2025-07-01
delete0
PRE
AI
J
Jingting Li
S
Sujing Wang *
王永 (Yong Wang)
H
Haoliang Zhou
X
Xiaolan Fu
DOI:10.1016/j.neucom.2025.129891delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Micro-expressions are fleeting spontaneous facial expressions that commonly occur in high-stakes scenarios and reflect humans' mental states. Thus, it is one of the crucial clues for lie detection. Furthermore, due to the brief duration of micro-expression, temporal information is important for micro-expression recognition. The paper proposes a Parallel Spatiotemporal Network (PSN) to recognize micro-expression. The proposed PSN includes a spatial sub-network and a temporal sub-network. The spatial sub-network is a shallow network with subtle motion information as the input. And the temporal sub-network is a network with a novel temporal feature extraction unit that extracts sparse temporal features of micro-expressions. Finally, we propose an element- wise addition with 1 x 1 convolutional kernel fusion model to fuse the spatial and temporal features. The proposed PSN gets better measurement metrics (such as recognition rate, F1 score, true positive rate, and true negative rate) than the other state-of-the-art methods on the consisted databases consisting of CASME, CASME II, CAS(ME)2, and SAMM.
Keywords:
Micro-expression recognition
Deep learning
Sparse features
Affective analysis
Lie detection

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

X
Xi'an Jiaotong University
Scholars:
1.2W
Papers: 4.4K
Citations: 8.4W
T
Tianjin Univ Technol
Scholars:
849
Papers: 311
Citations: 115