arrow
返回

ERTNet: an interpretable transformer-based framework for EEG emotion recognition

delete2024-01-17
delete7
delete
OA
AI
R
Ruixiang Liu
Y
Yihu Chao
X
Xianzheng Sha
S
Shuo Li *
S
Shijie Chang *
DOI:10.3389/fnins.2024.1320645delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Background Emotion recognition using EEG signals enables clinicians to assess patients' emotional states with precision and immediacy. However, the complexity of EEG signal data poses challenges for traditional recognition methods. Deep learning techniques effectively capture the nuanced emotional cues within these signals by leveraging extensive data. Nonetheless, most deep learning techniques lack interpretability while maintaining accuracy.Methods We developed an interpretable end-to-end EEG emotion recognition framework rooted in the hybrid CNN and transformer architecture. Specifically, temporal convolution isolates salient information from EEG signals while filtering out potential high-frequency noise. Spatial convolution discerns the topological connections between channels. Subsequently, the transformer module processes the feature maps to integrate high-level spatiotemporal features, enabling the identification of the prevailing emotional state.Results Experiments' results demonstrated that our model excels in diverse emotion classification, achieving an accuracy of 74.23% +/- 2.59% on the dimensional model (DEAP) and 67.17% +/- 1.70% on the discrete model (SEED-V). These results surpass the performances of both CNN and LSTM-based counterparts. Through interpretive analysis, we ascertained that the beta and gamma bands in the EEG signals exert the most significant impact on emotion recognition performance. Notably, our model can independently tailor a Gaussian-like convolution kernel, effectively filtering high-frequency noise from the input EEG data.Discussion Given its robust performance and interpretative capabilities, our proposed framework is a promising tool for EEG-driven emotion brain-computer interface.
Keyword:
EEG
emotion recognition
deep learning
transformer
interpretability
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Frontiers in Neuroscience 封面图
Frontiers in Neuroscience
IF:
3.2
论文数:
1.6W
被引数:
5.3W

机构

C
China Medical University
学者数:
2.6W
论文数: 1.6W
被引数: 2.5W
S
shanghai institute of microsystem & information technology, cas
学者数:
1.6K
论文数: 1.2K
被引数: 4
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Hyperimmune cow colostrum reduces diarrhoea due to rotavirus: a double‐blind, controlled clinical trial
err2008-01-21
err0
PREAI
errAK Mitra; D Mahalanabis; H Ashraf; L Unicomb; R Eeckels; S Tzipori
err分享
err收藏
MEG and EEG data analysis with MNE-Python使用mne-python进行MEG和EEG数据分析
err2013-01-01
err2.0K
errOAAI
errGramfort, Alexandre; Luessi, Martin; Larson, Eric; Engemann, Denis A.; Strohmeier, Daniel; Brodbeck, Christian; Goj, Roman; Jas, Mainak; Brooks, Teon; Parkkonen, Lauri; Haemaelaeinen, Matti
err分享
err收藏
CNN and LSTM based ensemble learning for human emotion recognition using EEG recordings
err2022-04-11
err72
PREAI
errIyer, Abhishek; Das, Srimit Sritik; Teotia, Reva; Maheshwari, Shishir; Sharma, Rishi Raj
err分享
err收藏
Advancing Remote Healthcare Using Humanoid and Affective Systems
err2022-09-15
err12
PREAI
errTripathi, Utkarsh; Rittvik, Saran J.; Chamola, Vinay; Jolfaei, Alireza; Chintanpalli, Ananthakrishna
err分享
err收藏
学者 查看更多内容