arrow
返回

Multimodal multi-instance learning for long-term ECG classification

delete2023-06-01
delete24
PRE
AI
廉
廉城 (Cheng Lian) *
Z
Zhigang Zeng
徐
徐冰瑢 (Bingrong Xu)
J
Junbin Zang
C
Chenyang Xue
DOI:10.1016/j.knosys.2023.110555delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, deep learning-based models have been widely used for electrocardiogram (ECG) classification tasks. Most ECG signals are long-term time series that contain a large number of sample points. However, existing deep learning-based models resize or crop the original long-term ECG signal due to the limitation of input size and hardware, which results in information loss. To address this issue, a multimodal multi-instance learning neural network (MAMIL) is proposed for long-term ECG classification. The proposed MAMIL has three major components. First, the original ECG signal and Gramian Angular Field (GAF) image converted from the ECG signal are utilized as multimodal inputs, which enables the model to learn complementary information between different modalities. Second, multi-instance learning (MIL) is introduced to avoid information loss. Each long-term ECG signal and GAF image are treated as bags, and each heartbeat from a long-term ECG signal and each patch from a GAF image are treated as instances. Convolutional neural networks (CNNs) are utilized to extract instance features from different modalities. Third, a novel attention mechanism-based feature fusion method is proposed to aggregate the instance features from multiple modalities to obtain the bag feature for final classification. Our feature fusion method adopts pooling to obtain positive instances, which can effectively eliminate redundant information and achieve low computational complexity. The proposed MAMIL is evaluated on both intrapatient and interpatient patterns of two commonly used ECG datasets. Experimental results show that our model not only outperforms common deep learning-based models, but also outperforms previous MIL-based models. (c) 2023 Elsevier B.V. All rights reserved.
Keyword:
Long-term ECG
Multimodal learning
Multi-instance learning
Attention mechanism

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

N
North University of China
学者数:
1.1W
论文数: 6.9K
被引数: 7.7K
W
Wuhan University of Technology
学者数:
3.4W
论文数: 2.4W
被引数: 4.4W
引用论文

引用论文

The effects of marathon running on expression of the complement regulatory proteins CD55 (DAF) and CD59 (MACIF) on red blood cells
err2006-11-07
err0
PREAI
errRichard J. Simpson; Geraint D. Florida-James; Greg P. Whyte; Natalie Middleton; Rob Shave; Keith George; Keith Guy
err分享
err收藏
New polymeric chemical sensors for determination of lead ions用于测定铅离子的新型聚合物化学传感器
err2009-03-28
err0
PREAI
errD. O. Kirsanov; O. V. Mednova; E. N. Pol’shin; A. V. Legin; M. Yu. Alyapyshev; I. I. Eliseev; V. A. Babain; Yu. G. Vlasov
err分享
err收藏
ECG Heartbeat Classification Using Multimodal Fusion使用多模态融合的ECG心跳分类
err2021-01-01
err73
errOAAI
errAhmad, Zeeshan; Tabassum, Anika; Guan, Ling; Khan, Naimul Mefraz
err分享
err收藏
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers
err2021-07-08
err43
errOAAI
errHendricks, Lisa Anne; Mellor, John; Schneider, Rosalia; Alayrac, Jean-Baptiste; Nematzadeh, Aida
err分享
err收藏
err2003-01-01
err0
PREAI
errXavier Descombes; Eugène Pechersky
err分享
err收藏
err分享
err收藏
学者 查看更多内容