arrow
返回

GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion Recognition

delete2023-07-01
delete43
delete
OA
AI
李阳 封面图
李阳 (Yang Li)
J
J.J. Chen
F
Fu Li *
B
Boxun Fu
H
Hao Wu
Y
Youshuo Ji
Y
Yijin Zhou
Y
Yi Niu
G
Guangming Shi
W
Wenming Zheng
DOI:10.1109/TAFFC.2022.3170428delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Previous electroencephalogram (EEG) emotion recognition relies on single-task learning, which may lead to overfitting and learned emotion features lacking generalization. In this paper, a graph-based multi-task self-supervised learning model (GMSS) for EEG emotion recognition is proposed. GMSS has the ability to learn more general representations by integrating multiple self-supervised tasks, including spatial and frequency jigsaw puzzle tasks, and contrastive learning tasks. By learning from multiple tasks simultaneously, GMSS can find a representation that captures all of the tasks thereby decreasing the chance of overfitting on the original task, i.e., emotion recognition task. In particular, the spatial jigsaw puzzle task aims to capture the intrinsic spatial relationships of different brain regions. Considering the importance of frequency information in EEG emotional signals, the goal of the frequency jigsaw puzzle task is to explore the crucial frequency bands for EEG emotion recognition. To further regularize the learned features and encourage the network to learn inherent representations, contrastive learning task is adopted in this work by mapping the transformed data into a common feature space. The performance of the proposed GMSS is compared with several popular unsupervised and supervised methods. Experiments on SEED, SEED-IV, and MPED datasets show that the proposed model has remarkable advantages in learning more discriminative and general features for EEG emotional signals.
Keyword:
EEG emotion recognition
multi-task learning
self-supervised learning
graph neural network

期刊

IEEE Transactions on Affective Computing 封面图
IEEE Transactions on Affective Computing
IF:
9.8
论文数:
1.4K
被引数:
9.1K

机构

S
southeast university - china
学者数:
5.3W
论文数: 4.9W
被引数: 57
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

The brain basis of emotion: A meta-analytic review情绪的大脑基础: 元分析综述
err2012-05-23
err1.6K
errOAAI
errLindquist, Kristen A.; Wager, Tor D.; Kober, Hedy; Bliss-Moreau, Eliza; Barrett, Lisa Feldman
err分享
err收藏
err分享
err收藏
Catabolite inactivation of fructose‐1,6‐bisphosphatase in yeast is mediated by the proteasome
err2001-10-18
err0
errOAAI
errStefan M. Schork; Gisela Bee; Michael Thumm; Dieter H. Wolf
err分享
err收藏
Visual perception supported by verbal mediation in an individual with cerebral visual impairment (CVI)
err2021-09-01
err0
errOAAI
errZahide Pamir; Corinna M. Bauer; Christopher R. Bennett; Barry S. Kran; Lotfi B. Merabet
err分享
err收藏
A cancer pharmacogenomic screen powering crowd-sourced advancement of drug combination prediction
err
IF0
err2017-10-09
err0
errOAAI
errMichael P Menden; Dennis Wang; Yuanfang Guan; Mike J Mason; Bence Szalai; Krishna C Bulusu; Thomas Yu; Jaewoo Kang; Minji Jeon; Russ Wolfinger; Tin Nguyen; Mikhail Zaslavskiy; Sock Jang; Zara Ghazoui; Mehmet Eren Ahsen; Robert Vogel; Elias Chaibub Neto; Thea Norman; Eric KY Tang; Mathew J Garnett; Giovanni Di Veroli; Stephen Fawell; Gustavo Stolovitzky; Justin Guinney; Jonathan R. Dry; Julio Saez-Rodriguez
err分享
err收藏
Diffractive and reactive scattering of H2 from Ru(0001): experimental and theoretical study
err2011-01-01
err0
PREAI
errP. Nieto; D. Farías; R. Miranda; M. Luppi; E. J. Baerends; M. F. Somers; M. J. T. C. van der Niet; R. A. Olsen; G. J. Kroes
err分享
err收藏
MPED: A Multi-Model Physiological Emotion Database for Discrete Emotion Recongnition
err2019-01-01
err184
errOAAI
errSong, Tengfei; Zheng, Wenming; Lu, Cheng; Zong, Yuan; Zhang, Xilei; Cui, Zhen
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容