arrow
返回

Graph-Based Facial Affect Analysis: A Review

delete2023-10-01
delete11
delete
OA
AI
Y
Yang Liu
X
Xingming Zhang
Y
Yante Li
J
Jinzhao Zhou
X
Xin Li
G
Guoying Zhao *
DOI:10.1109/TAFFC.2022.3215918delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
As one of the most important affective signals, facial affect analysis (FAA) is essential for developing human-computer interaction systems. Early methods focus on extracting appearance and geometry features associated with human affects while ignoring the latent semantic information among individual facial changes, leading to limited performance and generalization. Recent work attempts to establish a graph-based representation to model these semantic relationships and develop frameworks to leverage them for various FAA tasks. This article provides a comprehensive review of graph-based FAA, including the evolution of algorithms and their applications. First, the FAA background knowledge is introduced, especially on the role of the graph. We then discuss approaches widely used for graph-based affective representation in literature and show a trend towards graph construction. For the relational reasoning in graph-based FAA, existing studies are categorized according to their non-deep or deep learning methods, emphasizing the latest graph neural networks. Performance comparisons of the state-of-the-art graph-based FAA methods are also summarized. Finally, we discuss the challenges and potential directions. As far as we know, this is the first survey of graph-based FAA methods. Our findings can serve as a reference for future research in this field.
Keyword:
Facial expression recognition
micro-expression recognition
action unit detection
graph representation
graph relational reasoning
graph neural network

期刊

IEEE Transactions on Affective Computing 封面图
IEEE Transactions on Affective Computing
IF:
9.8
论文数:
1.4K
被引数:
9.1K

机构

U
University of Oulu
学者数:
1.5W
论文数: 1.3W
被引数: 1.6W
R
rutgers university system
学者数:
4.1W
论文数: 3.7W
被引数: 53
U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
An investigation on the role of 5‐hydroxytryptophan in the biosynthesis of melanins
err2002-12-17
err0
PREAI
errSusanna Vogliardi; Graziella Allegri; Antonella Bertazzo; Carlo V. L. Costa; Roberta Seraglia; Pietro Traldi
err分享
err收藏
Ability of troponin I to predict cardiac events in patients admitted from the emergency department
err2000-11-01
err0
PREAI
errMichael C Kontos; F.Philip Anderson; Ramin Alimard; Joseph P Ornato; James L Tatum; Robert L Jesse
err分享
err收藏
err分享
err收藏
Phase I trial of systemic intravenous infusion of interleukin‐13‐Pseudomonas exotoxin in patients with metastatic adrenocortical carcinoma
err2015-03-13
err0
errOAAI
errYi Liu‐Chittenden; Meenu Jain; Parag Kumar; Dhaval Patel; Rachel Aufforth; Vladimir Neychev; Samira Sadowski; Sudheer K. Gara; Bharat H. Joshi; Candice Cottle‐Delisle; Roxanne Merkel; Lily Yang; Markku Miettinen; Raj K. Puri; Electron Kebebew
err分享
err收藏
From Facial Expression Recognition to Interpersonal Relation Prediction
err2017-11-24
err170
errOAAI
errZhang, Zhanpeng; Luo, Ping; Loy, Chen Change; Tang, Xiaoou
err分享
err收藏
学者 查看更多内容