arrow
返回

Multimodal EEG-fNIRS Seizure Pattern Decoding Using Vision Transformer

delete2024-01-01
delete0
delete
OA
AI
R
Rafat Damseh
A
Abdelhadi Hireche
P
Parikshat Sirpal
A
Abdelkader Nasreddine Belkacem *
DOI:10.1109/OJCS.2024.3500032delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Epilepsy has been analyzed through uni-modality non-invasive brain measurements such as electroencephalogram (EEG) signal, but identifying seizure patterns is more challenging due to the non-stationary nature of the brain activity and various non-brain artifacts. In this article, we leverage a vision transformer model (ViT) to classify three types of seizure patterns based on multimodal EEG and functional near-infrared spectroscopy (fNIRS) recordings. We used spectral encoding techniques to capture temporal and spatial relationships for brain signals as feature map inputs to the transformer architecture. We evaluated model performance using the receiver operating characteristic (ROC) curves and the area under the curve (AUC), demonstrating that multimodal EEG-fNIRS signals improved the classification accuracy of seizure patterns. Our work showed that power spectral density (PSD) features often led to better results than features derived from dynamic mode decomposition (DMD), particularly for seizures with high-frequency oscillations (HFO) and generalized spike-and-wave discharge (GSWD) patterns, with an accuracy of 93.14% and 91.69%, respectively. Low-voltage fast activity (LVFA) seizures achieved consistently high performance in EEG, fNIRS, and multimodal EEG-fNIRS setups. Overall, our findings suggest the effectiveness of using the ViT architecture with multimodal brain data accompanied by appropriate spectral features to classify the neural activity of epileptic seizure patterns.
Keyword:
Electroencephalography
Functional near-infrared spectroscopy
Epilepsy
Transformers
Recording
Hafnium oxide
Brain modeling
Accuracy
Computer architecture
Standards
Electroencephalogram (EEG)
functional near-infrared spectroscopy (fNIRS)
low-voltage fast activity (LVFA)
generalized spike-and-wave discharge (GSWD)
high-frequency oscillation (HFO)
epilepsy
seizure
vision transformer

期刊

I
IEEE Open Journal of the Computer Society
IF:
8.2
论文数:
436
被引数:
810

机构

U
United Arab Emirates University
学者数:
8.8K
论文数: 7.4K
被引数: 10.0K
U
university of oklahoma system
学者数:
1.9W
论文数: 1.6W
被引数: 17
引用论文

引用论文

Transformers in Vision: A Survey视觉中的变形金刚: 一项调查
err2022-09-13
err1.1K
errOAAI
errKhan, Salman; Naseer, Muzammal; Hayat, Munawar; Zamir, Syed Waqas; Khan, Fahad Shahbaz; Shah, Mubarak
err分享
err收藏
err分享
err收藏
Epilepsy in adults成人癫痫
errLANCET
IF88.5
err2019-02-01
err1.3K
PREAI
errThijs, Roland D.; Surges, Rainer; O'Brien, Terence J.; Sander, Josemir W.
err分享
err收藏
err分享
err收藏
学者 查看更多内容