arrow
Return

Data Leakage and Evaluation Issues in Micro-Expression Analysis

delete2024-01-01
delete0
delete
OA
AI
T
Tuomas Varanka
Y
Yante Li
W
Wei Peng
G
Guoying Zhao *
DOI:10.1109/TAFFC.2023.3265063delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Micro-expressions have drawn increasing interest lately due to various potential applications. The task is, however, difficult as it incorporates many challenges from the fields of computer vision, machine learning and emotional sciences. Due to the spontaneous and subtle characteristics of micro-expressions, the available training and testing data are limited, which make evaluation complex. We show that data leakage and fragmented evaluation protocols are issues among the micro-expression literature. We find that fixing data leaks can drastically reduce model performance, in some cases even making the models perform similarly to a random classifier. To this end, we go through common pitfalls, propose a new standardized evaluation protocol using facial action units with over 2000 micro-expression samples, and provide an open source library that implements the evaluation protocols in a standardized manner. Code is publicly available in https://github.com/tvaranka/meb.
Keywords:
Protocols
Gold
Facial muscles
Training
Lips
Libraries
Data models
Action units
affective computing
benchmark
cross-dataset
emotion
protocol

Journal

IEEE Transactions on Affective Computing cover
IEEE Transactions on Affective Computing
IF:
9.8
Papers:
1.4K
Citations:
9.1K

Organization

U
University of Oulu
Scholars:
1.5W
Papers: 1.3W
Citations: 1.6W
S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W
Cited Papers

Cited Papers

errShare
errSave
Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements
err2019-07-17
err897
errOAAI
errBarrett, Lisa Feldman; Adolphs, Ralph; Marsella, Stacy; Martinez, Aleix M.; Pollak, Seth D.
errShare
errSave
Micro-expression action unit detection with spatial and channel attention
err2021-05-01
err32
errOAAI
errLi, Yante; Huang, Xiaohua; Zhao, Guoying
errShare
errSave
Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods
err2018-10-01
err147
errOAAI
errLi, Xiaobai; Hong, Xiaopeng; Moilanen, Antti; Huang, Xiaohua; Pfister, Tomas; Zhao, Guoying; Pietikainen, Matti
errShare
errSave
researcher View more