返回
Simultaneous EEG-fNIRS Data Classification Through Selective Channel Representation and Spectrogram Imaging
DOI:10.1109/JTEHM.2024.3448457.png)
摘要
En 中文
The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) can facilitate the advancement of brain-computer interfaces (BCIs). However, existing research in this domain has grappled with the challenge of the efficient selection of features, resulting in the underutilization of the temporal richness of EEG and the spatial specificity of fNIRS data.To effectively address this challenge, this study proposed a deep learning architecture called the multimodal DenseNet fusion (MDNF) model that was trained on two-dimensional (2D) EEG data images, leveraging advanced feature extraction techniques. The model transformed EEG data into 2D images using a short-time Fourier transform, applied transfer learning to extract discriminative features, and consequently integrated them with fNIRS-derived spectral entropy features. This approach aimed to bridge existing gaps in EEG-fNIRS-based BCI research by enhancing classification accuracy and versatility across various cognitive and motor imagery tasks.Experimental results on two public datasets demonstrated the superiority of our model over existing state-of-the-art methods.Thus, the high accuracy and precise feature utilization of the MDNF model demonstrates the potential in clinical applications for neurodiagnostics and rehabilitation, thereby paving the method for patient-specific therapeutic strategies.
Keyword:
Brain-computer interfaces
multimodal neuroimaging
short-time Fourier transform
spectrogram imaging
Brain-computer interfaces
multimodal neuroimaging
short-time Fourier transform
spectrogram imaging
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
4.4
论文数:
580
被引数:
1.7K
机构
引用论文
A Deep Convolutional Neural Network Method to Detect Seizures and Characteristic Frequencies Using Epileptic Electroencephalogram (EEG) Data使用癫痫脑电图 (EEG) 数据检测癫痫发作和特征频率的深度卷积神经网络方法
Enhancing the decoding accuracy of EEG signals by the introduction of anchored-STFT and adversarial data augmentation method
SCIENTIFIC REPORTS
IF3.9
Applying deep learning to single-trial EEG data provides evidence for complementary theories on action control将深度学习应用于单次试验EEG数据为动作控制的补充理论提供了证据
The present and future use of functional near-infrared spectroscopy (fNIRS) for cognitive neuroscience功能近红外光谱 (fNIRS) 在认知神经科学中的现状和未来应用

