.png){kind=icon}
Return
Expert-augmented machine learning
.png){kind=icon}
OA
AI
DOI：10.1073/pnas.1906831117.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Machine learning is proving invaluable across disciplines. However, its success is often limited by the quality and quantity of available data, while its adoption is limited by the level of trust afforded by given models. Human vs. machine performance is commonly compared empirically to decide whether a certain task should be performed by a computer or an expert. In reality, the optimal learning strategy may involve combining the complementary strengths of humans and machines. Here, we present expert-augmented machine learning (EAML), an automated method that guides the extraction of expert knowledge and its integration into machine-learned models. We used a large dataset of intensive-care patient data to derive 126 decision rules that predict hospital mortality. Using an online platform, we asked 15 clinicians to assess the relative risk of the subpopulation defined by each rule compared to the total sample. We compared the clinician-assessed risk to the empirical risk and found that, while clinicians agreed with the data in most cases, there were notable exceptions where they overestimated or underestimated the true risk. Studying the rules with greatest disagreement, we identified problems with the training data, including one miscoded variable and one hidden confounder. Filtering the rules based on the extent of disagreement between clinician-assessed risk and empirical risk, we improved performance on out-of-sample data and were able to train with less data. EAML provides a platform for automated creation of problem-specific priors, which help build robust and dependable machine-learning models in critical applications.
Keywords:
machine learning
medicine
computational medicine
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
P
IF:
9.1
Papers:
10.8W
Citations:
73.5W
Organization
Cited Papers
Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: A cross-sectional study.png)
PLOS MEDICINEOAAI
PLOS MEDICINEIF9.9
OAAIShareSaveShareSaveMediBoost: a Patient Stratification Tool for Interpretable Decision Making in the Era of Precision MedicineSCIENTIFIC REPORTSOAAI
SCIENTIFIC REPORTSIF3.9
OAAIShareSaveShareSaveShareSave
View more