arrow
Return

Micro-expression spotting based on optical flow features

delete2022-11-01
delete13
PRE
AI
Y
Yuhong He
Z
Zhongliang Xu
L
Lin Ma
H
Haifeng Li *
DOI:10.1016/j.patrec.2022.09.009delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Expression is the changes of facial organs due to facial muscle movement and an important way of hu-man emotional interaction. Neurophysiological studies show that micro-expressions (MEs) are not con-trolled by subjective consciousness and reflect people's real emotions. That is why MEs have significant value in public security applications. This paper proposes an automatic ME spotting method of high ac-curacy and interpretability. Firstly, we design the nose tip location-based image alignment method to remove global displacement caused by head shaking. Secondly, according to the action unit definition in the face coding system (FACS), we select fourteen regions of interest (ROI) to capture subtle facial move-ments. The dense optical flow is introduced to estimate local movements and time-domain variations of the ROIs. Thirdly, we design a peak detection method on the time-domain variation curves to locate the movement intervals precisely. Lastly, we propose an overlapping index to measure the consistency of changes in different organs. Evaluation on the CAS(ME)2 and SAMM Long Video database shows that our ME spotting method may achieve better accuracy with a relatively lower computation cost and can be applied to similar facial image processing applications.(c) 2022 Published by Elsevier B.V.
Keywords:
Farneback optical flow method
Overlap index
Nose tip location-based image alignment
Micro-expression spotting method

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
8.0K
Citations:
1.6W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
Cited Papers

Cited Papers

Building consumers' confidence in adopting e-commerce: a Malaysian case
err2007-01-01
err0
errOAAI
errMohiuddin Ahmed; Ramlah Hussein; Rashidah Minakhatun; Rafikul Islam
errShare
errSave
Electronic Structure and Photoluminescence Properties of Eu(η9-C9H9)2
err2019-11-26
err0
PREAI
errHarry Ramanantoanina; Lynda Merzoud; Jules Tshishimbi Muya; Henry Chermette; Claude Daul
errShare
errSave
CAS(ME)2: A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition
err2018-10-01
err72
PREAI
errQu, Fangbing; Wang, Su-Jing; Yan, Wen-Jing; Li, He; Wu, Shuhang; Fu, Xiaolan
errShare
errSave
errShare
errSave
Infraspinatus strength assessment before and after scapular muscles rehabilitation in professional volleyball players with scapular dyskinesis
err2010-12-01
err0
PREAI
errGiovanni Merolla; Elisa De Santis; John W. Sperling; Fabrizio Campi; Paolo Paladini; Giuseppe Porcellini
errShare
errSave
OntoMaton: a Bioportal powered ontology widget for Google Spreadsheets
err2012-12-24
err0
errOAAI
errEamonn Maguire; Alejandra González-Beltrán; Patricia L. Whetzel; Susanna-Assunta Sansone; Philippe Rocca-Serra
errShare
errSave
SAMM: A Spontaneous Micro-Facial Movement Dataset
err2018-01-01
err253
errOAAI
errDavison, Adrian K.; Lansley, Cliff; Costen, Nicholas; Tan, Kevin; Yap, Moi Hoon
errShare
errSave
no more