arrow
Return

Spatiotemporal Feature Descriptor for Micro-Expression Recognition Using Local Cube Binary Pattern

delete2019-01-01
delete9
delete
OA
AI
G
Guo, Ziqi
Y
Yang Yu *
Y
Yan Wang
S
Shixin Cen
DOI:10.1109/ACCESS.2019.2950339delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Micro-expression recognition has been an active research area in recent years, it plays an important role in psychology and public security. Due to the aspects of short duration and subtle movement, it is challenging to extract spatiotemporal features of micro-expressions. The existing methods only extract features in the three-dimensional orthogonal plane and fail to make full use of that information. To solve this problem, we propose a new Local Cubes Binary Patterns (LCBP) method for micro-expression recognition. LCBP is cascaded by the motion information $LCBP_{direction}$ , the amplitude information $LCBP_{amplitudes}$ , and the spatial information $LCBP_{3D}$ to obtain the spatiotemporal features. The advantage of LCBP is its ability to preserve the spatiotemporal information and the low feature dimension. Furthermore, to increase the discrimination of features in micro-expression sequences, we apply a differential calculation energy map to find regions of interest (ROI) for getting a weighted energy map. The final micro-expression feature acquired by fusing the LCBP features and the weighted energy map are classified through the Support Vector Machine (SVM). We evaluate the proposed method on four published micro-expression databases including SMIC, CASME, CASME2, SAMM. Experimental results demonstrate that our proposed method achieves promising performance for micro-expression recognition.
Keywords:
Feature extraction
Time-domain analysis
Optical flow
Spatiotemporal phenomena
Face recognition
Deep learning
Micro-expression recognition
differential energy map
local cubes binary patterns
SVM

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

T
Tianjin University of Commerce
Scholars:
2.6K
Papers: 1.7K
Citations: 2.5K
H
hebei university of technology
Scholars:
1.8W
Papers: 1.2W
Citations: 10
Cited Papers

Cited Papers

Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods
err2018-10-01
err147
errOAAI
errLi, Xiaobai; Hong, Xiaopeng; Moilanen, Antti; Huang, Xiaohua; Pfister, Tomas; Zhao, Guoying; Pietikainen, Matti
errShare
errSave
Foundations of VISAR analysis.
err
IF0
err2006-06-01
err0
errOAAI
errDaniel Dolan
errShare
errSave
Prevalence of DSM-IV Major Depression Among U.S. Military Personnel: Meta-Analysis and Simulation
err2012-08-01
err0
errOAAI
errAnne M. Gadermann; Charles C. Engel; James A. Naifeh; Matthew K. Nock; Maria Petukhova; Patcho N. Santiago; Benjamin Wu; Alan M. Zaslavsky; Ronald C. Kessler
errShare
errSave
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition
err2016-10-01
err329
PREAI
errLiu, Yong-Jin; Zhang, Jin-Kai; Yan, Wen-Jing; Wang, Su-Jing; Zhao, Guoying; Fu, Xiaolan
errShare
errSave
errShare
errSave
Electronic Structure and Photoluminescence Properties of Eu(η9-C9H9)2
err2019-11-26
err0
PREAI
errHarry Ramanantoanina; Lynda Merzoud; Jules Tshishimbi Muya; Henry Chermette; Claude Daul
errShare
errSave
errShare
errSave
researcher View more