arrow
Return

Sequence-level affective level estimation based on pyramidal facial expression features

delete2024-01-01
delete1
delete
OA
AI
J
Jiacheng Liao
H
Hao Yan
Z
Zhuoyi Zhou
J
Jiahui Pan
梁砚 cover
梁砚 (Yan Liang) *
DOI:10.1016/j.patcog.2023.109958delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
People tend to focus on changes in a certain complex human affect in the majority of practical applications of affective computing. Facial expression classification models are unable to represent all human affects through a limited number of expression categories. In this backdrop, this paper studies the Sequence -level affective level estimation (S -ALE), which is more relevant to real scenarios and can depict individual affective level in continuous manner. A spatio-temporal framework applied to S -ALE is proposed, which consists of a Facial Expression Features Pyramid Network (FEFPN) and a Temporal Transformer Encoder (TTE). FEFPN is capable of extracting pyramidal facial expression features, while TTE can effectively capture coarse -grained and finegrained temporal variations of facial sequences. The proposed model is evaluated on six public datasets across three typical S -ALE tasks (engagement prediction, fatigue detection, and pain assessment), and experimental results show that our method is comparable to or outperforms the state-of-the-art algorithms.
Keywords:
Sequence-level affective level estimation
Facial expression features pyramid network
Temporal transformer encoder
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

S
south china normal university
Scholars:
2.0W
Papers: 1.3W
Citations: 13