arrow
Return

GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion Recognition

delete2023-07-01
delete43
delete
OA
AI
李阳 cover
李阳 (Yang Li)
J
J.J. Chen
F
Fu Li *
B
Boxun Fu
H
Hao Wu
Y
Youshuo Ji
Y
Yijin Zhou
Y
Yi Niu
G
Guangming Shi
W
Wenming Zheng
DOI:10.1109/TAFFC.2022.3170428delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Previous electroencephalogram (EEG) emotion recognition relies on single-task learning, which may lead to overfitting and learned emotion features lacking generalization. In this paper, a graph-based multi-task self-supervised learning model (GMSS) for EEG emotion recognition is proposed. GMSS has the ability to learn more general representations by integrating multiple self-supervised tasks, including spatial and frequency jigsaw puzzle tasks, and contrastive learning tasks. By learning from multiple tasks simultaneously, GMSS can find a representation that captures all of the tasks thereby decreasing the chance of overfitting on the original task, i.e., emotion recognition task. In particular, the spatial jigsaw puzzle task aims to capture the intrinsic spatial relationships of different brain regions. Considering the importance of frequency information in EEG emotional signals, the goal of the frequency jigsaw puzzle task is to explore the crucial frequency bands for EEG emotion recognition. To further regularize the learned features and encourage the network to learn inherent representations, contrastive learning task is adopted in this work by mapping the transformed data into a common feature space. The performance of the proposed GMSS is compared with several popular unsupervised and supervised methods. Experiments on SEED, SEED-IV, and MPED datasets show that the proposed model has remarkable advantages in learning more discriminative and general features for EEG emotional signals.
Keywords:
EEG emotion recognition
multi-task learning
self-supervised learning
graph neural network

Journal

IEEE Transactions on Affective Computing cover
IEEE Transactions on Affective Computing
IF:
9.8
Papers:
1.4K
Citations:
9.1K

Organization

S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
Cited Papers

Cited Papers

The brain basis of emotion: A meta-analytic review
err2012-05-23
err1.6K
errOAAI
errLindquist, Kristen A.; Wager, Tor D.; Kober, Hedy; Bliss-Moreau, Eliza; Barrett, Lisa Feldman
errShare
errSave
errShare
errSave
Catabolite inactivation of fructose‐1,6‐bisphosphatase in yeast is mediated by the proteasome
err2001-10-18
err0
errOAAI
errStefan M. Schork; Gisela Bee; Michael Thumm; Dieter H. Wolf
errShare
errSave
Visual perception supported by verbal mediation in an individual with cerebral visual impairment (CVI)
err2021-09-01
err0
errOAAI
errZahide Pamir; Corinna M. Bauer; Christopher R. Bennett; Barry S. Kran; Lotfi B. Merabet
errShare
errSave
A cancer pharmacogenomic screen powering crowd-sourced advancement of drug combination prediction
err
IF0
err2017-10-09
err0
errOAAI
errMichael P Menden; Dennis Wang; Yuanfang Guan; Mike J Mason; Bence Szalai; Krishna C Bulusu; Thomas Yu; Jaewoo Kang; Minji Jeon; Russ Wolfinger; Tin Nguyen; Mikhail Zaslavskiy; Sock Jang; Zara Ghazoui; Mehmet Eren Ahsen; Robert Vogel; Elias Chaibub Neto; Thea Norman; Eric KY Tang; Mathew J Garnett; Giovanni Di Veroli; Stephen Fawell; Gustavo Stolovitzky; Justin Guinney; Jonathan R. Dry; Julio Saez-Rodriguez
errShare
errSave
Diffractive and reactive scattering of H2 from Ru(0001): experimental and theoretical study
err2011-01-01
err0
PREAI
errP. Nieto; D. Farías; R. Miranda; M. Luppi; E. J. Baerends; M. F. Somers; M. J. T. C. van der Niet; R. A. Olsen; G. J. Kroes
errShare
errSave
MPED: A Multi-Model Physiological Emotion Database for Discrete Emotion Recongnition
err2019-01-01
err184
errOAAI
errSong, Tengfei; Zheng, Wenming; Lu, Cheng; Zong, Yuan; Zhang, Xilei; Cui, Zhen
errShare
errSave
Spatial-Temporal Recurrent Neural Network for Emotion Recognition
err2019-03-01
err248
errOAAI
errZhang, Tong; Zheng, Wenming; Cui, Zhen; Zong, Yuan; Li, Yang
errShare
errSave
researcher View more