arrow
Return

A cross-database micro-expression recognition framework based on meta-learning

delete2024-11-30
delete0
PRE
AI
J
Ju Zhou
X
Xinyu Liu
Y
Yingjuan Jia
陈
陈通 (Tong Chen) *
DOI:10.1007/s10489-024-05896-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Micro-expressions are facial expressions that are revealed unconsciously when suppressing true emotions and are widely used in multiple tasks, such as deception detection. However, at present, the amount of available micro-expression data is small, and there are large differences between different databases, so it is still difficult to accurately perform cross-database micro-expression recognition, which hinders real applications of recognition. To address this issue, this article first presents a meta-learning framework suitable for cross-database micro-expression recognition named Meta-CDMERF, which is trained by combining multiple micro-expression databases. Then, a residual feature-wise linear (RFL) module is proposed to generate more feature distributions and adaptively choose representative features during multi micro-expression database training, thereby reducing the feature distance between samples of the same type in different databases. Next, a new loss function is designed, which combines the cross-entropy loss function with an interclass loss function. Specifically, the inter-class loss is based on the mean value of similar features from the support set and aims to increase the distance between samples of different categories, thereby capturing subtle changes in micro-expression images. Finally, the unweighted average recall (UAR) and unweighted F1 score (UF1) values of the proposed method on the CASME II database are 62.64% and 60.00%, respectively, reaching state-of-the-art performance.
Keywords:
Micro-expression recognition
Optical flow images
Meta-learning
Cross-database generalization

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.6K
Citations:
1.7W

Organization

S
southwest university - china
Scholars:
2.6W
Papers: 1.9W
Citations: 21
Cited Papers

Cited Papers

Micro-attention for micro-expression recognition
err2020-10-01
err93
errOAAI
errWang, Chongyang; Peng, Min; Bi, Tao; Chen, Tong
errShare
errSave
The ultrasonic impulse response of unidirectional carbon fibre laminates
err1994-09-01
err0
PREAI
errL.P. Scudder; D.A. Hutchins; J.T. Mottram
errShare
errSave
The graded distribution of the dorsal morphogen is initiated by selective nuclear transport in Drosophila
errCell
IF0
err1989-12-22
err0
errOAAI
errChristine A. Rushlow; Kyuhyung Han; James L. Manley; Michael Levine
errShare
errSave
Image Aesthetics Assessment Based on Hypernetwork of Emotion Fusion
err2024-01-01
err3
PREAI
errLan, Guipeng; Xiao, Shuai; Yang, Jiachen; Zhou, Yanshuang; Wen, Jiabao; Lu, Wen; Gao, Xinbo
errShare
errSave
Evolution of the COPD Assessment Test Score during Chronic Obstructive Pulmonary Disease Exacerbations: Determinants and Prognostic Value
err2013-01-01
err0
errOAAI
errDarwin Feliz-Rodriguez; Santiago Zudaire; Carlos Carpio; Elizabet Martínez; Antonia Gómez-Mendieta; Ana Santiago; Rodolfo Alvarez-Sala; Francisco García-Río
errShare
errSave
An Outphase-Interleaved Switched-Capacitor Hybrid Buck Converter With Relieved Capacitor Inrush Current and COUT-Free Operations
err2024-04-01
err0
PREAI
errXiongjie Zhang; Qiaobo Ma; Yang Jiang; Anyang Zhao; Man-Kay Law; Rui P. Martins; Pui-In Mak
errShare
errSave
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition
err2016-10-01
err329
PREAI
errLiu, Yong-Jin; Zhang, Jin-Kai; Yan, Wen-Jing; Wang, Su-Jing; Zhao, Guoying; Fu, Xiaolan
errShare
errSave
researcher View more