arrow
返回

Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder

delete2024-01-01
delete0
delete
OA
AI
Z
Zhao Zhang
B
Bor‐Shyh Lin
C
Chih‐Wei Peng
B
Bor-Shing Lin
DOI:10.1109/tnsre.2024.3394738delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Sleep staging serves as a fundamental assessment for sleep quality measurement and sleep disorder diagnosis. Although current deep learning approaches have successfully integrated multimodal sleep signals, enhancing the accuracy of automatic sleep staging, certain challenges remain, as follows: 1) optimizing the utilization of multi-modal information complementarity, 2) effectively extracting both long- and short-range temporal features of sleep information, and 3) addressing the class imbalance problem in sleep data. To address these challenges, this paper proposes a two-stream encode-decoder network, named TSEDSleepNet, which is inspired by the depth sensitive attention and automatic multi-modal fusion (DSA2F) framework. In TSEDSleepNet, a two-stream encoder is used to extract the multiscale features of electrooculogram (EOG) and electroencephalogram (EEG) signals. And a self-attention mechanism is utilized to fuse the multiscale features, generating multi-modal saliency features. Subsequently, the coarser-scale construction module (CSCM) is adopted to extract and construct multi-resolution features from the multiscale features and the salient features. Thereafter, a Transformer module is applied to capture both long- and short-range temporal features from the multi-resolution features. Finally, the long- and short-range temporal features are restored with low-layer details and mapped to the predicted classification results. Additionally, the Lovász loss function is applied to alleviate the class imbalance problem in sleep datasets. Our proposed method was tested on the Sleep-EDF-39 and Sleep-EDF-153 datasets, and it achieved classification accuracies of 88.9% and 85.2% and Macro-F1 scores of 84.8% and 79.7%, respectively, thus outperforming conventional traditional baseline models. These results highlight the efficacy of the proposed method in fusing multi-modal information. This method has potential for application as an adjunct tool for diagnosing sleep disorders.

期刊

IEEE Transactions on Neural Systems and Rehabilitation Engineering 封面图
IEEE Transactions on Neural Systems and Rehabilitation Engineering
IF:
5.2
论文数:
1.1K
被引数:
1.7W

机构

T
taipei medical university
学者数:
564
论文数: 235
被引数: 4.3K
W
Wuyi University
学者数:
597
论文数: 189
被引数: 1.7K
N
National Yang Ming Chiao Tung University
学者数:
1.3K
论文数: 496
被引数: 1.0W
学者 查看更多机构
引用论文

引用论文

U2-Net: Going deeper with nested U-structure for salient object detectionU2-Net: 基于嵌套U结构的显著性目标检测
err2020-10-01
err1.2K
errOAAI
errQin, Xuebin; Zhang, Zichen; Huang, Chenyang; Dehghan, Masood; Zaiane, Osmar R.; Jagersand, Martin
err分享
err收藏
学者 查看更多内容