arrow
Return

Recognizing Spontaneous Micro-Expression Using a Three-Stream Convolutional Neural Network

delete2019-01-01
delete67
delete
OA
AI
B
Baolin Song
K
Ke Li
Y
Yuan Zong *
朱杰 (Jie Zhu)
W
Wenming Zheng
J
Jingang Shi
L
Li Zhao *
DOI:10.1109/ACCESS.2019.2960629delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Micro-expression recognition (MER) has attracted much attention with various practical applications, particularly in clinical diagnosis and interrogations. In this paper, we propose a three-stream convolutional neural network (TSCNN) to recognize MEs by learning ME-discriminative features in three key frames of ME videos. We design a dynamic-temporal stream, static-spatial stream, and local-spatial stream module for the TSCNN that respectively attempt to learn and integrate temporal, entire facial region, and facial local region cues in ME videos with the goal of recognizing MEs. In addition, to allow the TSCNN to recognize MEs without using the index values of apex frames, we design a reliable apex frame detection algorithm. Extensive experiments are conducted with five public ME databases: CASME II, SMIC-HS, SAMM, CAS(ME)(2), and CASME. Our proposed TSCNN is shown to achieve more promising recognition results when compared with many other methods.
Keywords:
Micro-expression recognition
convolutional neural networks
apex frame location
spatiotemporal information
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
University of Oulu
Scholars:
1.5W
Papers: 1.3W
Citations: 1.6W
S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57