返回
Multimodal EEG-fNIRS Seizure Pattern Decoding Using Vision Transformer
DOI:10.1109/OJCS.2024.3500032.png)
摘要
En 中文
Epilepsy has been analyzed through uni-modality non-invasive brain measurements such as electroencephalogram (EEG) signal, but identifying seizure patterns is more challenging due to the non-stationary nature of the brain activity and various non-brain artifacts. In this article, we leverage a vision transformer model (ViT) to classify three types of seizure patterns based on multimodal EEG and functional near-infrared spectroscopy (fNIRS) recordings. We used spectral encoding techniques to capture temporal and spatial relationships for brain signals as feature map inputs to the transformer architecture. We evaluated model performance using the receiver operating characteristic (ROC) curves and the area under the curve (AUC), demonstrating that multimodal EEG-fNIRS signals improved the classification accuracy of seizure patterns. Our work showed that power spectral density (PSD) features often led to better results than features derived from dynamic mode decomposition (DMD), particularly for seizures with high-frequency oscillations (HFO) and generalized spike-and-wave discharge (GSWD) patterns, with an accuracy of 93.14% and 91.69%, respectively. Low-voltage fast activity (LVFA) seizures achieved consistently high performance in EEG, fNIRS, and multimodal EEG-fNIRS setups. Overall, our findings suggest the effectiveness of using the ViT architecture with multimodal brain data accompanied by appropriate spectral features to classify the neural activity of epileptic seizure patterns.
Keyword:
Electroencephalography
Functional near-infrared spectroscopy
Epilepsy
Transformers
Recording
Hafnium oxide
Brain modeling
Accuracy
Computer architecture
Standards
Electroencephalogram (EEG)
functional near-infrared spectroscopy (fNIRS)
low-voltage fast activity (LVFA)
generalized spike-and-wave discharge (GSWD)
high-frequency oscillation (HFO)
epilepsy
seizure
vision transformer
期刊
I
IF:
8.2
论文数:
436
被引数:
810
机构
引用论文
Enhancing Sodium Ion Transport in a PEO-Based Solid Polymer Electrolyte System with NaAlO2 Active Fillers用NaAlO2活性填料增强PEO基固体聚合物电解质体系中钠离子的传输
Brain Computer Interfaces for Improving the Quality of Life of Older Adults and Elderly Patients改善老年人和老年患者生活质量的脑机接口
An automated system for epilepsy detection using EEG brain signals based on deep learning approach基于深度学习方法的脑电脑信号癫痫检测自动化系统
Reevaluating the mechanisms of focal ictogenesis: The role of low-voltage fast activity
EPILEPSIA
IF6.6

