arrow
Return

Micro-expression spotting based on optical flow features

delete2022-11-01
delete13
PRE
AI
Y
Yuhong He
Z
Zhongliang Xu
L
Lin Ma
H
Haifeng Li *
DOI:10.1016/j.patrec.2022.09.009delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Expression is the changes of facial organs due to facial muscle movement and an important way of hu-man emotional interaction. Neurophysiological studies show that micro-expressions (MEs) are not con-trolled by subjective consciousness and reflect people's real emotions. That is why MEs have significant value in public security applications. This paper proposes an automatic ME spotting method of high ac-curacy and interpretability. Firstly, we design the nose tip location-based image alignment method to remove global displacement caused by head shaking. Secondly, according to the action unit definition in the face coding system (FACS), we select fourteen regions of interest (ROI) to capture subtle facial move-ments. The dense optical flow is introduced to estimate local movements and time-domain variations of the ROIs. Thirdly, we design a peak detection method on the time-domain variation curves to locate the movement intervals precisely. Lastly, we propose an overlapping index to measure the consistency of changes in different organs. Evaluation on the CAS(ME)2 and SAMM Long Video database shows that our ME spotting method may achieve better accuracy with a relatively lower computation cost and can be applied to similar facial image processing applications.(c) 2022 Published by Elsevier B.V.
Keywords:
Farneback optical flow method
Overlap index
Nose tip location-based image alignment
Micro-expression spotting method

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
7.8K
Citations:
1.6W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66