返回
DRER: Deep Learning-Based Driver's Real Emotion Recognizer
DOI:10.3390/s21062166.png)
摘要
En 中文
In intelligent vehicles, it is essential to monitor the driver's condition; however, recognizing the driver's emotional state is one of the most challenging and important tasks. Most previous studies focused on facial expression recognition to monitor the driver's emotional state. However, while driving, many factors are preventing the drivers from revealing the emotions on their faces. To address this problem, we propose a deep learning-based driver's real emotion recognizer (DRER), which is a deep learning-based algorithm to recognize the drivers' real emotions that cannot be completely identified based on their facial expressions. The proposed algorithm comprises of two models: (i) facial expression recognition model, which refers to the state-of-the-art convolutional neural network structure; and (ii) sensor fusion emotion recognition model, which fuses the recognized state of facial expressions with electrodermal activity, a bio-physiological signal representing electrical characteristics of the skin, in recognizing even the driver's real emotional state. Hence, we categorized the driver's emotion and conducted human-in-the-loop experiments to acquire the data. Experimental results show that the proposed fusing approach achieves 114% increase in accuracy compared to using only the facial expressions and 146% increase in accuracy compare to using only the electrodermal activity. In conclusion, our proposed method achieves 86.8% recognition accuracy in recognizing the driver's induced emotion while driving situation.
Keyword:
human-machine interface
emotion recognition
real emotion
driver's emotional state
deep learning
sensor fusion
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.2W
被引数:
20.9W
机构
引用论文
Somatic embryogenesis and plant regeneration in Chinese soybean (Glycine max (L.) Merr.)—impacts of mannitol, abscisic acid, and explant age中国大豆(Glycine max (L.) Merr.)的体细胞胚胎发生和植株再生——甘露醇、脱落酸和外植体年龄的影响
Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements重新考虑情感表达: 从人类面部运动推断情感的挑战
A Deep-Learning Model for Subject-Independent Human Emotion Recognition Using Electrodermal Activity Sensors
SENSORS
IF3.5
Emotion Recognition From Multi-Channel EEG Signals by Exploiting the Deep Belief-Conditional Random Field Framework
IEEE ACCESS
IF3.6
DREAMER: A Database for Emotion Recognition Through EEG and ECG Signals From Wireless Low-cost Off-the-Shelf Devices梦想家: 通过来自无线低成本现成设备的EEG和ECG信号进行情感识别的数据库

