arrow
返回

A Collaborative Multimodal Learning-Based Framework for COVID-19 Diagnosis

delete2024-11-01
delete1
PRE
AI
Y
Yuan Gao
M
Maoguo Gong *
Y
Yew-Soon Ong
A
A. K. Qin
Y
Yue Wu
F
Fei Xie
DOI:10.1109/TNNLS.2023.3290188delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The pandemic of coronavirus disease 2019 (COVID-19) has led to a global public health crisis, which caused millions of deaths and billions of infections, greatly increasing the pressure on medical resources. With the continuous emergence of viral mutations, developing automated tools for COVID-19 diagnosis is highly desired to assist the clinical diagnosis and reduce the tedious workload of image interpretation. However, medical images in a single site are usually of a limited amount or weakly labeled, while integrating data scattered around different institutions to build effective models is not allowed due to data policy restrictions. In this article, we propose a novel privacy-preserving cross-site framework for COVID-19 diagnosis with multimodal data, seeking to effectively leverage heterogeneous data from multiple parties while preserving patients' privacy. Specifically, a Siamese branched network is introduced as the backbone to capture inherent relationships across heterogeneous samples. The redesigned network is capable of handling semisupervised inputs in multimodalities and conducting task-specific training, in order to improve the model performance of various scenarios. The framework achieves significant improvement compared with state-of-the-art methods, as we demonstrate through extensive simulations on real-world datasets.
Keyword:
COVID-19
Medical diagnostic imaging
Data models
Computed tomography
Task analysis
Artificial intelligence
Training
Coronavirus disease 2019 (COVID-19) diagnosis
multimodal data
multiparty learning
task-specific modeling

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

S
Swinburne University of Technology
学者数:
9.3K
论文数: 1.2W
被引数: 2.0W
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China武汉地区2019例新型冠状病毒感染患者临床特征分析
errLANCET
IF88.5
err2020-02-01
err2.7W
errOAAI
errHuang, Chaolin; Wang, Yeming; Li, Xingwang; Ren, Lili; Zhao, Jianping; Hu, Yi; Zhang, Li; Fan, Guohui; Xu, Jiuyang; Gu, Xiaoying; Cheng, Zhenshun; Yu, Ting; Xia, Jiaan; Wei, Yuan; Wu, Wenjuan; Xie, Xuelei; Yin, Wen; Li, Hui; Liu, Min; Xiao, Yan; Gao, Hong; Guo, Li; Xie, Jungang; Wang, Guangfa; Jiang, Rongmeng; Gao, Zhancheng; Jin, Qi; Wang, Jianwei; Cao, Bin
err分享
err收藏
A deep-learning pipeline for the diagnosis and discrimination of viral, non-viral and COVID-19 pneumonia from chest X-ray images
err2021-04-15
err100
errOAAI
errWang, Guangyu; Liu, Xiaohong; Shen, Jun; Wang, Chengdi; Li, Zhihuan; Ye, Linsen; Wu, Xingwang; Chen, Ting; Wang, Kai; Zhang, Xuan; Zhou, Zhongguo; Yang, Jian; Sang, Ye; Deng, Ruiyun; Liang, Wenhua; Yu, Tao; Gao, Ming; Wang, Jin; Yang, Zehong; Cai, Huimin; Lu, Guangming; Zhang, Lingyan; Yang, Lei; Xu, Wenqin; Wang, Winston; Olevera, Andrea; Ziyar, Ian; Zhang, Charlotte; Li, Oulan; Liao, Weihua; Liu, Jun; Chen, Wen; Chen, Wei; Shi, Jichan; Zheng, Lianghong; Zhang, Longjiang; Yan, Zhihan; Zou, Xiaoguang; Lin, Guiping; Cao, Guiqun; Lau, Laurance L.; Mo, Long; Liang, Yong; Roberts, Michael; Sala, Evis; Schonlieb, Carola-Bibiane; Fok, Manson; Lau, Johnson Yiu-Nam; Xu, Tao; He, Jianxing; Zhang, Kang; Li, Weimin; Lin, Tianxin
err分享
err收藏
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
A Weakly-Supervised Framework for COVID-19 Classification and Lesion Localization From Chest CT
err2020-08-01
err397
errOAAI
errWang, Xinggang; Deng, Xianbo; Fu, Qing; Zhou, Qiang; Feng, Jiapei; Ma, Hui; Liu, Wenyu; Zheng, Chuansheng
err分享
err收藏
The future of digital health with federated learning通过联邦学习实现数字健康的未来
err2020-09-14
err1.0K
errOAAI
errRieke, Nicola; Hancox, Jonny; Li, Wenqi; Milletari, Fausto; Roth, Holger R.; Albarqouni, Shadi; Bakas, Spyridon; Galtier, Mathieu N.; Landman, Bennett A.; Maier-Hein, Klaus; Ourselin, Sebastien; Sheller, Micah; Summers, Ronald M.; Trask, Andrew; Xu, Daguang; Baust, Maximilian; Cardoso, M. Jorge
err分享
err收藏
COVID-19-CT-CXR: A Freely Accessible and Weakly Labeled Chest X-Ray and CT Image Collection on COVID-19 From Biomedical Literature
err2021-03-01
err43
errOAAI
errPeng, Yifan; Tang, Yu-Xing; Lee, Sungwon; Zhu, Yingying; Summers, Ronald M.; Lu, Zhiyong
err分享
err收藏
An Uncertainty-Aware Transfer Learning-Based Framework for COVID-19 Diagnosis基于不确定性感知迁移学习的新型冠状病毒肺炎诊断框架
err2021-04-01
err84
errOAAI
errShamsi, Afshar; Asgharnezhad, Hamzeh; Jokandan, Shirin Shamsi; Khosravi, Abbas; Kebria, Parham M.; Nahavandi, Darius; Nahavandi, Saeid; Srinivasan, Dipti
err分享
err收藏
学者 查看更多内容