arrow
Return

Dimensional emotion recognition from camera-based PRV features

delete2023-10-01
delete2
PRE
AI
K
Kai Zhou *
M
Markus Schinle
W
Wilhelm Stork
DOI:10.1016/j.ymeth.2023.08.014delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Heart rate variability (HRV) is an important indicator of autonomic nervous system activity and can be used for the identification of affective states. The development of remote Photoplethysmography (rPPG) technology has made it possible to measure pulse rate variability (PRV) using a camera without any sensor-skin contact, which is highly correlated to HRV, thus, enabling contactless assessment of emotional states. In this study, we employed ten machine learning techniques to identify emotions using camera-based PRV features. Our experimental results show that the best classification model achieved a coordination correlation coefficient of 0.34 for value recognition and 0.36 for arousal recognition. The rPPG-based measurement has demonstrated promising results in detecting HAHV (high-arousal high-valence) emotions with high accuracy. Furthermore, for emotions with less noticeable variations, such as sadness, the rPPG-based measure outperformed the baseline deep network for facial expression analysis.
Keywords:
Remote photoplethysmography
PRV
Dimensional affect estimation
Affective computing

Journal

Methods cover
Methods
IF:
4.3
Papers:
4.8K
Citations:
2.4W

Organization

K
karlsruhe institute of technology
Scholars:
2.0W
Papers: 1.4W
Citations: 23
H
Helmholtz Association
Scholars:
13.2W
Papers: 10.7W
Citations: 145