arrow
Return

Cross-Modal Data Programming Enables Rapid Medical Machine Learning

delete2020-05-01
delete31
delete
OA
AI
J
Jared Dunnmon *
A
Alexander Ratner
K
Khaled Saab
N
Nishith Khandwala
M
Matthew Markert
H
Hersh Sagreiya
R
Roger E. Goldman
C
Christopher Lee‐Messer
M
Matthew P. Lungren
D
Daniel L. Rubin
C
Christopher Ré
DOI:10.1016/j.patter.2020.100019delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
A major bottleneck in developing clinically impactful machine learning models is a lack of labeled training data for model supervision. Thus, medical researchers increasingly turn to weaker, noisier sources of supervision, such as leveraging extractions from unstructured text reports to supervise image classification. A key challenge in weak supervision is combining sources of information that may differ in quality and have correlated errors. Recently, a statistical theory of weak supervision called data programming has shown promise in addressing this challenge. Data programming now underpinsmany deployed machine-learning systems in the technology industry, even for critical applications. We propose a new technique for applying data programming to the problem of cross-modal weak supervision in medicine, wherein weak labels derived from an auxiliary modality (e.g., text) are used to train models over a different target modality (e.g., images). We evaluate our approach on diverse clinical tasks via direct comparison to institution-scale, hand-labeled data-sets. We find that our supervision technique increases model performance by up to 6 points area under the receiver operating characteristic curve (ROC-AUC) over baseline methods by improving both coverage and quality of the weak labels. Our approach yields models that on average perform within 1.75 points ROC-AUC of those supervised with physician-years of hand labeling and outperform those supervised with physician-months of hand labeling by 10.25 points ROC-AUC, while using only person-days of developer time and clinician work-a time saving of 96%. Our results suggest that modern weak supervision techniques such as data programming may enable more rapid development and deployment of clinically useful machine-learning models.
Keywords:
DEEP
ALGORITHM
CANCER
TIMES
EEG
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Patterns cover
Patterns
IF:
7.4
Papers:
938
Citations:
3.6K

Organization

S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W