.png){kind=icon}
.png){kind=icon}
Return
Micro-Expression Recognition Under Occlusion Based on Expression Semantic Surface Texture
.png){kind=icon}
PRE
AI
DOI：10.1111/nyas.70180.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Micro-expression recognition is a fine-grained task aimed at capturing subtle, brief facial movements. However, facial occlusions in real-world scenarios significantly challenge existing models, often leading to feature sparsity and disconnection. This arises from both the loss of spatial and temporal information, further disrupting feature dependencies across facial regions. To address these issues, we introduce the concept of expression semantic surface texture, designed to separate and reconstruct expression-aware and expression-irrelevant features. We propose a dual-branch collaborative network: one branch extracts spatial features using optical flow and frame differencing, while the second branch filters out expression-irrelevant features using occlusion position embedding and reconstructs expression-aware features in occluded regions. Experiments show that our network effectively restores disrupted features and outperforms recent state-of-the-art methods in occluded micro-expression recognition.
Keywords:
disrupted feature dependencies
expression semantic surface texture
feature sparsity
micro-expression recognition under occlusion
Journal
IF:
4.8
Papers:
2.5K
Citations:
4.4W