Return
Micro-expression spotting based on optical flow features
DOI:10.1016/j.patrec.2022.09.009.png)
Abstract
En 中文
Expression is the changes of facial organs due to facial muscle movement and an important way of hu-man emotional interaction. Neurophysiological studies show that micro-expressions (MEs) are not con-trolled by subjective consciousness and reflect people's real emotions. That is why MEs have significant value in public security applications. This paper proposes an automatic ME spotting method of high ac-curacy and interpretability. Firstly, we design the nose tip location-based image alignment method to remove global displacement caused by head shaking. Secondly, according to the action unit definition in the face coding system (FACS), we select fourteen regions of interest (ROI) to capture subtle facial move-ments. The dense optical flow is introduced to estimate local movements and time-domain variations of the ROIs. Thirdly, we design a peak detection method on the time-domain variation curves to locate the movement intervals precisely. Lastly, we propose an overlapping index to measure the consistency of changes in different organs. Evaluation on the CAS(ME)2 and SAMM Long Video database shows that our ME spotting method may achieve better accuracy with a relatively lower computation cost and can be applied to similar facial image processing applications.(c) 2022 Published by Elsevier B.V.
Keywords:
Farneback optical flow method
Overlap index
Nose tip location-based image alignment
Micro-expression spotting method
Journal
IF:
3.3
Papers:
7.8K
Citations:
1.6W

