arrow
Return

Attention-Based Temporal Graph Representation Learning for EEG-Based Emotion Recognition

delete2024-10-01
delete0
PRE
AI
C
Chao Li
F
Feng Wang
Z
Ziping Zhao *
H
Haishuai Wang
B
Björn W. Schuller
DOI:10.1109/JBHI.2024.3395622delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Due to the objectivity of emotional expression in the central nervous system, EEG-based emotion recognition can effectively reflect humans' internal emotional states. In recent years, convolutional neural networks (CNNs) and recurrent neural networks (RNNs) have made significant strides in extracting local features and temporal dependencies from EEG signals. However, CNNs ignore spatial distribution information from EEG electrodes; moreover, RNNs may encounter issues such as exploding/vanishing gradients and high time consumption. To address these limitations, we propose an attention-based temporal graph representation network (ATGRNet) for EEG-based emotion recognition. Firstly, a hierarchical attention mechanism is introduced to integrate feature representations from both frequency bands and channels ordered by priority in EEG signals. Second, a graph convolutional neural network with top-k operation is utilized to capture internal relationships between EEG electrodes under different emotion patterns. Next, a residual-based graph readout mechanism is applied to accumulate the EEG feature node-level representations into graph-level representations. Finally, the obtained graph-level representations are fed into a temporal convolutional network (TCN) to extract the temporal dependencies between EEG frames. We evaluated our proposed ATGRNet on the SEED, DEAP and FACED datasets. The experimental findings show that the proposed ATGRNet surpasses the state-of-the-art graph-based mehtods for EEG-based emotion recognition.
Keywords:
Electroencephalography
Feature extraction
Emotion recognition
Convolution
Brain modeling
Electrodes
Graph neural networks
Affective computing
attention mechan- ism
EEG
emotion recognition
graph convolution network

Journal

IEEE Journal of Biomedical and Health Informatics cover
IEEE Journal of Biomedical and Health Informatics
IF:
6.8
Papers:
4.5K
Citations:
2.0W

Organization

U
University of Augsburg
Scholars:
3.6K
Papers: 3.0K
Citations: 5.2K
T
Tianjin Normal University
Scholars:
4.6K
Papers: 3.2K
Citations: 4.2K
I
Imperial College London
Scholars:
8.3W
Papers: 7.3W
Citations: 11.1W
researcher View more organizations