arrow
返回

Data Leakage and Evaluation Issues in Micro-Expression Analysis

delete2024-01-01
delete0
delete
OA
AI
T
Tuomas Varanka
Y
Yante Li
W
Wei Peng
G
Guoying Zhao *
DOI:10.1109/TAFFC.2023.3265063delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Micro-expressions have drawn increasing interest lately due to various potential applications. The task is, however, difficult as it incorporates many challenges from the fields of computer vision, machine learning and emotional sciences. Due to the spontaneous and subtle characteristics of micro-expressions, the available training and testing data are limited, which make evaluation complex. We show that data leakage and fragmented evaluation protocols are issues among the micro-expression literature. We find that fixing data leaks can drastically reduce model performance, in some cases even making the models perform similarly to a random classifier. To this end, we go through common pitfalls, propose a new standardized evaluation protocol using facial action units with over 2000 micro-expression samples, and provide an open source library that implements the evaluation protocols in a standardized manner. Code is publicly available in https://github.com/tvaranka/meb.
Keyword:
Protocols
Gold
Facial muscles
Training
Lips
Libraries
Data models
Action units
affective computing
benchmark
cross-dataset
emotion
protocol

期刊

IEEE Transactions on Affective Computing 封面图
IEEE Transactions on Affective Computing
IF:
9.8
论文数:
1.4K
被引数:
9.1K

机构

U
University of Oulu
学者数:
1.5W
论文数: 1.3W
被引数: 1.6W
S
Stanford University
学者数:
9.6W
论文数: 8.2W
被引数: 17.0W
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Micro-expression action unit detection with spatial and channel attention
err2021-05-01
err32
errOAAI
errLi, Yante; Huang, Xiaohua; Zhao, Guoying
err分享
err收藏
Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods
err2018-10-01
err147
errOAAI
errLi, Xiaobai; Hong, Xiaopeng; Moilanen, Antti; Huang, Xiaohua; Pfister, Tomas; Zhao, Guoying; Pietikainen, Matti
err分享
err收藏
学者 查看更多内容