arrow
返回

Micro-expression recognition based on SqueezeNet and C3D

delete2022-06-07
delete10
PRE
AI
S
Shuhua Liu
Y
Yushu Ren
L
Lanting Li
X
Xiaoyu Sun
Y
Yu Song
C
Chih‐Cheng Hung *
DOI:10.1007/s00530-022-00949-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Micro-expression recognition has attracted extensive attention from psychological and computer vision communities due to its multiple real-life applications. Compared with macro-expression, the change of micro-expression is subtle and difficult for detection and capture. Hence, the recognition is challenging. This paper proposes a micro-expression recognition model SQU-C3D which combines SqueezeNet and C3D methods. The features of micro-expression are mainly reflected in the apex frame, therefore a lightweight network called SqueezeNet is adopted to implement a reliable apex frame spotting method for dataset without apex frame labels. The position of the apex frame is detected by comparing the feature difference between the current and onset frames. In addition, the Convolutional 3D (C3D) network is utilized for micro-expression recognition due to its strong capability of extracting spatial-temporal features. The apex frame determined by SqueezeNet is fed into the C3D network along with the onset and offset frames, and the micro-expression is recognized by learning the features of these three key frames. Extensive experiments are conducted on three spontaneous micro-expression databases, namely, CASME II, SAMM, and SMIC-HS, where CASME II and SAMM include apex frame labels, whereas SMIC-HS does not. SQU-C3D achieves accuracy of 80.29% with 7 classes, 81.33% with 5 classes and 79.12% with 3 classes on the micro-expression benchmark dataset of CASME II, SAMM and SMIC-HS, respectively. Experimental results reveal that the proposed framework performs better than the state-of-the-art methods in the comparison.
Keyword:
Micro-expression recognition
Spot apex frame
SqueezeNet
C3D

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

N
northeast normal university - china
学者数:
1.2W
论文数: 9.2K
被引数: 23
U
university system of georgia
学者数:
7.3W
论文数: 6.6W
被引数: 101
C
changchun university of science & technology
学者数:
6.7K
论文数: 4.2K
被引数: 3
学者 查看更多机构
引用论文

引用论文

Electronic Structure and Photoluminescence Properties of Eu(η9-C9H9)2
err2019-11-26
err0
PREAI
errHarry Ramanantoanina; Lynda Merzoud; Jules Tshishimbi Muya; Henry Chermette; Claude Daul
err分享
err收藏
err分享
err收藏
学者 查看更多内容