返回
Improved Action Unit Detection Based on a Hybrid Model
DOI:10.1109/ACCESS.2023.3297266.png)
摘要
En 中文
Facial action detection and facial expression recognition are two closely intertwined problems in behavior analysis. This paper presents evidence that model architectures designed for facial expression recognition can be seamlessly adapted for the action units detection task, taking advantage of the structural similarity between the two problems. As a sample case, we have adapted the Pyramid crOss-fuSion TransformER (POSTER) model for action unit detection by adjusting the architecture to handle a multilabel problem with one output per action unit. Then, we tuned the training parameters and retrained the model to achieve state-of-the-art performance on two widely used datasets: DISFA and BP4D. The results obtained with a standard 3-fold cross-validation setup show an average F1 score of 67.8% for DISFA and 65.5% for BP4D. These results outperform state-of-the-art models for AU detection, support the effectiveness of the approach, and suggest placing higher efforts on adapting existing architectures to leverage the synergies between facial expression recognition and action unit detection.
Keyword:
Affective computing
action unit detection
facial expression recognition
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Types of Parent Verbal Responsiveness That Predict Language in Young Children With Autism Spectrum Disorder预测自闭症谱系障碍幼儿语言的父母言语反应类型
BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression databaseBP4D-Spontaneous: 高分辨率自发三维动态面部表情数据库

