arrow
Return

Uncertainty quantification for deep learning

delete2025-12-17
delete0
delete
OA
AI
P
Peter Jan van Leeuwen *
J
J. Christine Chiu
C
C. Kevin Yang
DOI:10.1017/eds.2025.10027delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We present a critical survey on the consistency of uncertainty quantification used in deep learning and highlight partial uncertainty coverage and many inconsistencies. We then provide a comprehensive and statistically consistent framework for uncertainty quantification in deep learning that accounts for all major sources of uncertainty: input data, training and testing data, neural network weights, and machine-learning model imperfections, targeting regression problems. We systematically quantify each source by applying Bayes' theorem and conditional probability densities and introduce a fast, practical implementation method. We demonstrate its effectiveness on a simple regression problem and a real-world application: predicting cloud autoconversion rates using a neural network trained on aircraft measurements from the Azores and guided by a two-moment bin model of the stochastic collection equation. In this application, uncertainty from the training and testing data dominates, followed by input data, neural network model, and weight variability. Finally, we highlight the practical advantages of this methodology, showing that explicitly modeling training data uncertainty improves robustness to new inputs that fall outside the training data, and enhances model reliability in real-world scenarios.
Keywords:
deep learning
machine learning
uncertainty quantification
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

E
Environmental Data Science
IF:
1.7
Papers:
23
Citations:
0

Organization

C
Colorado State University System
Scholars:
1.3W
Papers: 1.0W
Citations: 3
Cited Papers

Cited Papers

Comparison of aircraft measurements during GoAmazon2014/5 and ACRIDICON-CHUVA
err2020-02-11
err13
errOAAI
errMei, Fan; Wang, Jian; Comstock, Jennifer M.; Weigel, Ralf; Kraemer, Martina; Mahnke, Christoph; Shilling, John E.; Schneider, Johannes; Schulz, Christiane; Long, Charles N.; Wendisch, Manfred; Machado, Luiz A. T.; Schmid, Beat; Krisna, Trismono; Pekour, Mikhail; Hubbe, John; Giez, Andreas; Weinzierl, Bernadett; Zoeger, Martin; Poehlker, Mira L.; Schlager, Hans; Cecchini, Micael A.; Andreae, Meinrat O.; Martin, Scot T.; de Sa, Suzane S.; Fan, Jiwen; Tomlinson, Jason; Springston, Stephen; Poeschl, Ulrich; Artaxo, Paulo; Poehlker, Christopher; Klimach, Thomas; Minikin, Andreas; Afchine, Armin; Borrmann, Stephan
errShare
errSave
An introduction to MCMC for machine learning
err2003-01-01
err1.9K
errOAAI
errAndrieu, C; de Freitas, N; Doucet, A; Jordan, MI
errShare
errSave
errShare
errSave
errShare
errSave
Nonlinear Data Assimilation
err2015-01-01
err0
PREAI
errPeter Jan Van Leeuwen; Yuan Cheng; Sebastian Reich
errShare
errSave
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
err2021-12-01
err1.2K
errOAAI
errAbdar, Moloud; Pourpanah, Farhad; Hussain, Sadiq; Rezazadegan, Dana; Liu, Li; Ghavamzadeh, Mohammad; Fieguth, Paul; Cao, Xiaochun; Khosravi, Abbas; Acharya, U. Rajendra; Makarenkov, Vladimir; Nahavandi, Saeid
errShare
errSave
A neural network approach to estimating a posteriori distributions of Bayesian retrieval problems
err2018-08-09
err28
errOAAI
errPfreundschuh, Simon; Eriksson, Patrick; Duncan, David; Rydberg, Bengt; Hakansson, Nina; Thoss, Anke
errShare
errSave
Observational Constraints on Warm Cloud Microphysical Processes Using Machine Learning and Optimization Techniques
err2021-01-23
err0
errOAAI
errJ. Christine Chiu; C. Kevin Yang; Peter Jan van Leeuwen; Graham Feingold; Robert Wood; Yann Blanchard; Fan Mei; Jian Wang
errShare
errSave
Fast Cloud Droplet Probe (FCDP) Instrument Handbook
err
IF0
err2020-01-01
err0
errOAAI
errSusanne Glienke; Fan Mei
errShare
errSave
researcher View more