.png){kind=icon}
返回
An improved multi-input deep convolutional neural network for automatic emotion recognition
.png){kind=icon}
OA
AI
DOI：10.3389/fnins.2022.965871.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Current decoding algorithms based on a one-dimensional (1D) convolutional neural network (CNN) have shown effectiveness in the automatic recognition of emotional tasks using physiological signals. However, these recognition models usually take a single modal of physiological signal as input, and the inter-correlates between different modalities of physiological signals are completely ignored, which could be an important source of information for emotion recognition. Therefore, a complete end-to-end multi-input deep convolutional neural network (MI-DCNN) structure was designed in this study. The newly designed 1D-CNN structure can take full advantage of multi-modal physiological signals and automatically complete the process from feature extraction to emotion classification simultaneously. To evaluate the effectiveness of the proposed model, we designed an emotion elicitation experiment and collected a total of 52 participants' physiological signals including electrocardiography (ECG), electrodermal activity (EDA), and respiratory activity (RSP) while watching emotion elicitation videos. Subsequently, traditional machine learning methods were applied as baseline comparisons; for arousal, the baseline accuracy and f1-score of our dataset were 62.9 +/- 0.9% and 0.628 +/- 0.01, respectively; for valence, the baseline accuracy and f1-score of our dataset were 60.3 +/- 0.8% and 0.600 +/- 0.01, respectively. Differences between the MI-DCNN and single-input DCNN were also compared, and the proposed method was verified on two public datasets (DEAP and DREAMER) as well as our dataset. The computing results in our dataset showed a significant improvement in both tasks compared to traditional machine learning methods (t-test, arousal: p = 9.7E-03 < 0.01, valence: 6.5E-03 < 0.01), which demonstrated the strength of introducing a multi-input convolutional neural network for emotion recognition based on multi-modal physiological signals.
Keyword:
biological signals
multi-modality
emotion recognition
convolutional neural network
machine learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.2
论文数:
1.6W
被引数:
5.3W
机构
引用论文
An adversarial discriminative temporal convolutional network for EEG-based cross-domain emotion recognition用于基于EEG的跨域情感识别的对抗判别时间卷积网络OAAI
OAAI分享收藏Utilizing Deep Learning Towards Multi-Modal Bio-Sensing and Vision-Based Affective Computing利用深度学习实现多模态生物传感和基于视觉的情感计算OAAI
OAAI分享收藏DREAMER: A Database for Emotion Recognition Through EEG and ECG Signals From Wireless Low-cost Off-the-Shelf Devices梦想家: 通过来自无线低成本现成设备的EEG和ECG信号进行情感识别的数据库OAAI
OAAI分享收藏MPED: A Multi-Model Physiological Emotion Database for Discrete Emotion Recongnition.png)
IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏Comparing Recognition Performance and Robustness of Multimodal Deep Learning Models for Multimodal Emotion Recognition面向多模态情感识别的多模态深度学习模型识别性能与鲁棒性比较
PREAI
分享收藏
查看更多内容