arrow
Return

Aleatory-aware deep uncertainty quantification for transfer learning

delete2022-04-01
delete11
PRE
AI
H
H M Dipu Kabir *
A
Abbas Khosravi
S
Subrota Kumar Mondal
S
Saeid Nahavandi
U
U. Rajendra Acharya
DOI:10.1016/j.compbiomed.2022.105246delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The user does not have any idea about the credibility of outcomes from deep neural networks (DNN) when uncertainty quantification (UQ) is not employed. However, current Deep UQ classification models capture mostly epistemic uncertainty. Therefore, this paper aims to propose an aleatory-aware Deep UQ method for classifi-cation problems. First, we train DNNs through transfer learning and collect numeric output posteriors for all training samples instead of logical outputs. Then we determine the probability of happening a certain class from K-nearest output posteriors of the same DNN in training samples. We name this probability as opacity score, as the paper focuses on the detection of opacity on X-ray images. This score reflects the level of aleatory on the sample. When the NN is certain on the classification of the sample, the probability of happening a class becomes much higher than the probabilities of others. Probabilities for different classes become close to each other for a highly uncertain classification outcome. To capture the epistemic uncertainty, we train multiple DNNs with different random initializations, model selection, and augmentations to observe the effect of these training pa-rameters on prediction and uncertainty. To reduce execution time, we first obtain features from the pre-trained NN. Then we apply features to the ensemble of fully connected layers to get the distribution of opacity score during the test. We also train several ResNet and DenseNet DNNs to observe the effect of model selection on prediction and uncertainty. The paper also demonstrates a patient referral framework based on the proposed uncertainty quantification. The scripts of the proposed method are available at the following link: https://github. com/dipuk0506/Aleatory-aware-UQ.
Keywords:
Patient referral
Uncertainty
COVID
Aleatoric
Epistemic
Heteroscedastic

Journal

Computers in Biology and Medicine cover
Computers in Biology and Medicine
IF:
6.3
Papers:
8.3K
Citations:
3.3W

Organization

H
Harvard University
Scholars:
26.5W
Papers: 22.0W
Citations: 28.7W
A
asia university taiwan
Scholars:
2.0K
Papers: 2.8K
Citations: 5
D
Deakin University
Scholars:
2.0W
Papers: 2.1W
Citations: 2.8W
researcher View more organizations
Cited Papers

Cited Papers

XMVB 2.0: A new version of Xiamen valence bond program
err2014-12-20
err0
PREAI
errZhenhua Chen; Fuming Ying; Xun Chen; Jinshuai Song; Peifeng Su; Lingchun Song; Yirong Mo; Qianer Zhang; Wei Wu
errShare
errSave
Visualizing Uncertainty About the Future
errSCIENCE
IF45.8
err2011-09-09
err471
PREAI
errSpiegelhalter, David; Pearson, Mike; Short, Ian
errShare
errSave
Learning-to-augment strategy using noisy and denoised data: Improving generalizability of deep CNN for the detection of COVID-19 in X-ray images
err2021-09-01
err34
errOAAI
errMomeny, Mohammad; Neshat, Ali Asghar; Hussain, Mohammad Arafat; Kia, Solmaz; Marhamati, Mahmoud; Jahanbakhshi, Ahmad; Hamarneh, Ghassan
errShare
errSave
Differences and Similarities in Insular and Temporal Pole MRI Gray Matter Volume Abnormalities in First-Episode Schizophrenia and Affective Psychosis
err2003-11-01
err0
errOAAI
errKiyoto Kasai; Martha E. Shenton; Dean F. Salisbury; Toshiaki Onitsuka; Sarah K. Toner; Deborah Yurgelun-Todd; Ron Kikinis; Ferenc A. Jolesz; Robert W. McCarley
errShare
errSave
Probabilistic modelling of wind turbine power curves with application of heteroscedastic Gaussian Process regression
err2020-04-01
err60
errOAAI
errRogers, T. J.; Gardner, P.; Dervilis, N.; Worden, K.; Maguire, A. E.; Papatheou, E.; Cross, E. J.
errShare
errSave
Optimal uncertainty-guided neural network training
err2021-02-01
err21
errOAAI
errKabir, H. M. Dipu; Khosravi, Abbas; Kavousi-Fard, Abdollah; Nahavandi, Saeid; Srinivasan, Dipti
errShare
errSave
An Uncertainty-Aware Transfer Learning-Based Framework for COVID-19 Diagnosis
err2021-04-01
err84
errOAAI
errShamsi, Afshar; Asgharnezhad, Hamzeh; Jokandan, Shirin Shamsi; Khosravi, Abbas; Kebria, Parham M.; Nahavandi, Darius; Nahavandi, Saeid; Srinivasan, Dipti
errShare
errSave
The emergence of artistic ability following traumatic brain injury
err2014-01-14
err0
errOAAI
errAkira Midorikawa; Mitsuru Kawamura
errShare
errSave
researcher View more