arrow
返回

Improved Action Unit Detection Based on a Hybrid Model

delete2023-01-01
delete2
delete
OA
AI
Y
Yuyan Wu *
M
Miguel Arevalillo‐Herráez
P
Pablo Arnau‐González
DOI:10.1109/ACCESS.2023.3297266delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Facial action detection and facial expression recognition are two closely intertwined problems in behavior analysis. This paper presents evidence that model architectures designed for facial expression recognition can be seamlessly adapted for the action units detection task, taking advantage of the structural similarity between the two problems. As a sample case, we have adapted the Pyramid crOss-fuSion TransformER (POSTER) model for action unit detection by adjusting the architecture to handle a multilabel problem with one output per action unit. Then, we tuned the training parameters and retrained the model to achieve state-of-the-art performance on two widely used datasets: DISFA and BP4D. The results obtained with a standard 3-fold cross-validation setup show an average F1 score of 67.8% for DISFA and 65.5% for BP4D. These results outperform state-of-the-art models for AU detection, support the effectiveness of the approach, and suggest placing higher efforts on adapting existing architectures to leverage the synergies between facial expression recognition and action unit detection.
Keyword:
Affective computing
action unit detection
facial expression recognition

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
University of Valencia
学者数:
2.5W
论文数: 2.1W
被引数: 24
引用论文

引用论文

An investigation on the role of 5‐hydroxytryptophan in the biosynthesis of melanins
err2002-12-17
err0
PREAI
errSusanna Vogliardi; Graziella Allegri; Antonella Bertazzo; Carlo V. L. Costa; Roberta Seraglia; Pietro Traldi
err分享
err收藏
SnapShot: Insulin/IGF1 Signaling
errCell
IF0
err2015-05-01
err0
errOAAI
errDavid K.G. Ma; Christian Stolte; James R. Krycer; David E. James; Seán I. O’Donoghue
err分享
err收藏
Requirement for Croquemort in Phagocytosis of Apoptotic Cells in Drosophila
err1999-06-18
err0
PREAI
errNathalie C. Franc; Pascal Heitzler; R. Alan B.; Ezekowitz; Kristin White
err分享
err收藏
err分享
err收藏
BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression databaseBP4D-Spontaneous: 高分辨率自发三维动态面部表情数据库
err2014-10-01
err492
PREAI
errZhang, Xing; Yin, Lijun; Cohn, Jeffrey F.; Canavan, Shaun; Reale, Michael; Horowitz, Andy; Liu, Peng; Girard, Jeffrey M.
err分享
err收藏
学者 查看更多内容