.png){kind=icon}
.png){kind=icon}
Return
Multimodal EEG-fNIRS Seizure Pattern Decoding Using Vision Transformer
.png){kind=icon}
OA
AI
DOI：10.1109/OJCS.2024.3500032.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Epilepsy has been analyzed through uni-modality non-invasive brain measurements such as electroencephalogram (EEG) signal, but identifying seizure patterns is more challenging due to the non-stationary nature of the brain activity and various non-brain artifacts. In this article, we leverage a vision transformer model (ViT) to classify three types of seizure patterns based on multimodal EEG and functional near-infrared spectroscopy (fNIRS) recordings. We used spectral encoding techniques to capture temporal and spatial relationships for brain signals as feature map inputs to the transformer architecture. We evaluated model performance using the receiver operating characteristic (ROC) curves and the area under the curve (AUC), demonstrating that multimodal EEG-fNIRS signals improved the classification accuracy of seizure patterns. Our work showed that power spectral density (PSD) features often led to better results than features derived from dynamic mode decomposition (DMD), particularly for seizures with high-frequency oscillations (HFO) and generalized spike-and-wave discharge (GSWD) patterns, with an accuracy of 93.14% and 91.69%, respectively. Low-voltage fast activity (LVFA) seizures achieved consistently high performance in EEG, fNIRS, and multimodal EEG-fNIRS setups. Overall, our findings suggest the effectiveness of using the ViT architecture with multimodal brain data accompanied by appropriate spectral features to classify the neural activity of epileptic seizure patterns.
Keywords:
Electroencephalography
Functional near-infrared spectroscopy
Epilepsy
Transformers
Recording
Hafnium oxide
Brain modeling
Accuracy
Computer architecture
Standards
Electroencephalogram (EEG)
functional near-infrared spectroscopy (fNIRS)
low-voltage fast activity (LVFA)
generalized spike-and-wave discharge (GSWD)
high-frequency oscillation (HFO)
epilepsy
seizure
vision transformer
Journal
I
IF:
8.2
Papers:
411
Citations:
810