arrow
Return

Micro-Expression Key Frame Inference

delete
delete0
PRE
AI
S
Sujing Wang
M
Miao Yu
J
Jingting Li
周凌 cover
周凌 (Ling Zhou)
Z
Zizhao Dong
M
Mengyi Sun
X
Xiaolan Fu
DOI:10.1109/TAFFC.2025.3548284delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Micro-expressions (MEs) are brief, involuntary facial movements critical for detecting lies, drawing growing interest in psychology and computer science. However, annotating ME can burden human coders with excessive time commitment and overwhelming information that compromises coding reliability and efficiency. Such difficulties in data annotation also led to the small sample size problem and hindered the development of ME analysis. Specifically, our psychological research highlights the complexities involved in human annotation of key frames. To facilitate the annotating process of ME, we proposed the Micro-Expression Key Frame Inference (ME-KFI) problem, aiming to identify MEs’ temporal locations from a single frame, reducing manual annotation effort. We propose a Micro-Expression Contrastive Identification Annotation (MECIA) method as a solution to ME-KFI, including three modules: a contrastive module, an identification module, and an annotation module, corresponding to the three steps of manual annotation. The network’s outputs infer the key frame of ME clips. MECIA demonstrates superior performance over random baselines on SAMM and CAS(ME)$^{2}$ databases and maintains comparable recognition accuracy with ground-truth clips.
Keywords:
Micro-expression
key frame inference
micro-expression annotation

Journal

IEEE Transactions on Affective Computing cover
IEEE Transactions on Affective Computing
IF:
9.8
Papers:
1.4K
Citations:
9.1K

Organization

S
shanghai jiao tong university
Scholars:
15.7W
Papers: 11.7W
Citations: 159
M
Macau University of Science and Technology
Scholars:
2.4K
Papers: 1.4K
Citations: 9.7K
I
Institute of Psychology
Scholars:
784
Papers: 364
Citations: 961
J
Jiangsu University of Science and Technology
Scholars:
6.5K
Papers: 2.2K
Citations: 263
researcher View more organizations
Cited Papers

Cited Papers

Micro-expression action unit detection with spatial and channel attention
err2021-05-01
err32
errOAAI
errLi, Yante; Huang, Xiaohua; Zhao, Guoying
errShare
errSave
Micron-BERT: BERT-Based Facial Micro-Expression Recognition
err2023-06-01
err0
errOAAI
errXuan-Bac Nguyen; Chi Nhan Duong; Xin Li; Susan Gauch; Han-Seok Seo; Khoa Luu
errShare
errSave
Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods
err2018-10-01
err147
errOAAI
errLi, Xiaobai; Hong, Xiaopeng; Moilanen, Antti; Huang, Xiaohua; Pfister, Tomas; Zhao, Guoying; Pietikainen, Matti
errShare
errSave
Facial Action Unit-based Deep Learning Framework for Spotting Macro- and Micro-expressions in Long Video Sequences
err2021-10-17
err0
PREAI
errBo Yang; Jianming Wu; Zhiguang Zhou; Megumi Komiya; Koki Kishimoto; Jianfeng Xu; Keisuke Nonaka; Toshiharu Horiuchi; Satoshi Komorita; Gen Hattori; Sei Naito; Yasuhiro Takishima
errShare
errSave
errShare
errSave
researcher View more