.png){kind=icon}
返回
MSLTE: multiple self-supervised learning tasks for enhancing EEG emotion recognition
.png){kind=icon}
PRE
AI
DOI：10.1088/1741-2552/ad3c28.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Objective. The instability of the EEG acquisition devices may lead to information loss in the channels or frequency bands of the collected EEG. This phenomenon may be ignored in available models, which leads to the overfitting and low generalization of the model. Approach. Multiple self-supervised learning tasks are introduced in the proposed model to enhance the generalization of EEG emotion recognition and reduce the overfitting problem to some extent. Firstly, channel masking and frequency masking are introduced to simulate the information loss in certain channels and frequency bands resulting from the instability of EEG, and two self-supervised learning-based feature reconstruction tasks combining masked graph autoencoders (GAE) are constructed to enhance the generalization of the shared encoder. Secondly, to take full advantage of the complementary information contained in these two self-supervised learning tasks to ensure the reliability of feature reconstruction, a weight sharing (WS) mechanism is introduced between the two graph decoders. Thirdly, an adaptive weight multi-task loss (AWML) strategy based on homoscedastic uncertainty is adopted to combine the supervised learning loss and the two self-supervised learning losses to enhance the performance further. Main results. Experimental results on SEED, SEED-V, and DEAP datasets demonstrate that: (i) Generally, the proposed model achieves higher averaged emotion classification accuracy than various baselines included in both subject-dependent and subject-independent scenarios. (ii) Each key module contributes to the performance enhancement of the proposed model. (iii) It achieves higher training efficiency, and significantly lower model size and computational complexity than the state-of-the-art (SOTA) multi-task-based model. (iv) The performances of the proposed model are less influenced by the key parameters. Significance. The introduction of the self-supervised learning task helps to enhance the generalization of the EEG emotion recognition model and eliminate overfitting to some extent, which can be modified to be applied in other EEG-based classification tasks.
Keyword:
EEG emotion recognition
mask-based self-supervised learning
multi-task learning
graph autoencoder
weight sharing
期刊
IF:
3.8
论文数:
4.0K
被引数:
1.4W
机构
暂无机构信息
引用论文
An adversarial discriminative temporal convolutional network for EEG-based cross-domain emotion recognition用于基于EEG的跨域情感识别的对抗判别时间卷积网络
OAAI
OAAI分享收藏Comparing Recognition Performance and Robustness of Multimodal Deep Learning Models for Multimodal Emotion Recognition面向多模态情感识别的多模态深度学习模型识别性能与鲁棒性比较
PREAI
分享收藏分享收藏分享收藏A systematic review on affective computing: emotion models, databases, and recent advances情感计算的系统综述: 情感模型，数据库和最新进展.png)
INFORMATION FUSIONOAAI
INFORMATION FUSIONIF15.5
OAAI分享收藏Deep Learning With Convolutional Neural Networks for EEG Decoding and VisualizationHUMAN BRAIN MAPPINGOAAI
HUMAN BRAIN MAPPINGIF3.3
OAAI分享收藏GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion RecognitionGMSS: 基于图的多任务自监督学习的脑电情绪识别
OAAI
OAAI分享收藏
查看更多内容