arrow
返回

Simplified Transfer Learning for Chest Radiography Models Using Less Data

delete2022-11-01
delete24
PRE
AI
A
Andrew Sellergren *
C
Christina Chen
Z
Zaid Nabulsi
Y
Yuanzhen Li
A
Aaron Maschinot
A
Aaron Sarna
J
Jenny Huang
C
Charles T. Lau
S
Sreenivasa Raju Kalidindi
M
Mozziyar Etemadi
F
Florencia Garcia-Vicente
D
David Melnick
Y
Yun Liu
E
Eswaran, Krish
D
Daniel Tse
N
Neeral Beladia
D
Dilip Krishnan
S
Shravya Shetty
DOI:10.1148/radiol.212482delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Background: Developing deep learning models for radiology requires large data sets and substantial computational resources. Data set size limitations can be further exacerbated by distribution shifts, such as rapid changes in patient populations and standard of care during the COVID-19 pandemic. A common partial mitigation is transfer learning by pretraining a generic network on a large nonmedical data set and then fine-tuning on a task-specific radiology data set. Purpose: To reduce data set size requirements for chest radiography deep learning models by using an advanced machine learning approach (supervised contrastive [SupCon] learning) to generate chest radiography networks. Materials and Methods: SupCon helped generate chest radiography networks from 821 544 chest radiographs from India and the United States. The chest radiography networks were used as a starting point for further machine learning model development for 10 prediction tasks (eg, airspace opacity, fracture, tuberculosis, and COVID-19 outcomes) by using five data sets comprising 684 955 chest radiographs from India, the United States, and China. Three model development setups were tested (linear classifier, nonlinear classifier, and fine-tuning the full network) with different data set sizes from eight to 85. Results: Across a majority of tasks, compared with transfer learning from a nonmedical data set, SupCon reduced label requirements up to 688-fold and improved the area under the receiver operating characteristic curve (AUC) at matching data set sizes. At the extreme low-data regimen, training small nonlinear models by using only 45 chest radiographs yielded an AUC of 0.95 (noninferior to radiologist performance) in classifying microbiology-confirmed tuberculosis in external validation. At a more moderate data regimen, training small nonlinear models by using only 528 chest radiographs yielded an AUC of 0.75 in predicting severe COVID-19 outcomes. Conclusion: Supervised contrastive learning enabled performance comparable to state-of-the-art deep learning models in multiple clinical tasks by using as few as 45 images and is a promising method for predictive modeling with use of small data sets and for predicting outcomes in shifting patient populations. (c) RSNA, 2022
Keyword:
TUBERCULOSIS

期刊

Radiology 封面图
Radiology
IF:
15.2
论文数:
4.0W
被引数:
6.0W

机构

F
Feinberg School of Medicine
学者数:
1.9W
论文数: 1.5W
被引数: 34
G
Google Incorporated
学者数:
3.5K
论文数: 1.8K
被引数: 8
N
Northwestern University
学者数:
6.2W
论文数: 5.3W
被引数: 3.9K
学者 查看更多机构
引用论文

引用论文

Chest Radiograph Interpretation with Deep Learning Models: Assessment with Radiologist-adjudicated Reference Standards and Population-adjusted Evaluation
errRADIOLOGY
IF15.2
err2020-02-01
err173
PREAI
errMajkowska, Anna; Mittal, Sid; Steiner, David F.; Reicher, Joshua J.; McKinney, Scott Mayer; Duggan, Gavin E.; Eswaran, Krish; Chen, Po-Hsuan Cameron; Liu, Yun; Kalidindi, Sreenivasa Raju; Ding, Alexander; Corrado, Greg S.; Tse, Daniel; Shetty, Shravya
err分享
err收藏
Bile Acid-Induced Arrhythmia Is Mediated by Muscarinic M2 Receptors in Neonatal Rat Cardiomyocytes
err2010-03-15
err0
errOAAI
errSiti H. Sheikh Abdul Kadir; Michele Miragoli; Shadi Abu-Hayyeh; Alexey V. Moshkov; Qilian Xie; Verena Keitel; Viacheslav O. Nikolaev; Catherine Williamson; Julia Gorelik
err分享
err收藏
LPS promote Osteosarcoma invasion and migration through TLR4/HOTAIR
errGene
IF0
err2019-01-01
err0
PREAI
errNing Wang; Xiaona Meng; Yongyi Liu; Yong Chen; Qingwei Liang
err分享
err收藏
Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists胸部x光片诊断的深度学习: CheXNeXt算法与实践放射科医生的回顾性比较
err2018-11-20
err728
errOAAI
errRajpurkar, Pranav; Irvin, Jeremy; Ball, Robyn L.; Zhu, Kaylie; Yang, Brandon; Mehta, Hershel; Duan, Tony; Ding, Daisy; Bagul, Aarti; Langlotz, Curtis P.; Patel, Bhavik N.; Yeom, Kristen W.; Shpanskaya, Katie; Blankenberg, Francis G.; Seekins, Jayne; Amrhein, Timothy J.; Mong, David A.; Halabi, Safwan S.; Zucker, Evan J.; Ng, Andrew Y.; Lungren, Matthew P.
err分享
err收藏
Automatic Tuberculosis Screening Using Chest Radiographs使用胸部x光片进行自动结核病筛查
err2014-02-01
err375
PREAI
errJaeger, Stefan; Karargyris, Alexandros; Candemir, Sema; Folio, Les; Siegelman, Jenifer; Callaghan, Fiona; Xue, Zhiyun; Palaniappan, Kannappan; Singh, Rahul K.; Antani, Sameer; Thoma, George; Wang, Yi-Xiang; Lu, Pu-Xuan; McDonald, Clement J.
err分享
err收藏
The Polymerisation of Dietary Sugars by Dental Plaque
err1967-01-01
err0
PREAI
errP. Critchley; J.M. Wood; C.A. Saxton; S.A. Leach
err分享
err收藏
Searching for pneumothorax in x-ray images using autoencoded deep features
err2021-05-10
err8
errOAAI
errSze-To, Antonio; Riasatian, Abtin; Tizhoosh, H. R.
err分享
err收藏
Recalibration of deep learning models for abnormality detection in smartphone-captured chest radiograph
err2021-02-15
err17
errOAAI
errKuo, Po-Chih; Tsai, Cheng Che; Lopez, Diego M.; Karargyris, Alexandros; Pollard, Tom J.; Johnson, Alistair E. W.; Celi, Leo Anthony
err分享
err收藏
Automated abnormality classification of chest radiographs using deep convolutional neural networks
err2020-05-14
err126
errOAAI
errTang, Yu-Xing; Tang, You-Bao; Peng, Yifan; Yan, Ke; Bagheri, Mohammadhadi; Redd, Bernadette A.; Brandon, Catherine J.; Lu, Zhiyong; Han, Mei; Xiao, Jing; Summers, Ronald M.
err分享
err收藏
学者 查看更多内容