arrow
返回

Aleatory-aware deep uncertainty quantification for transfer learning

delete2022-04-01
delete11
PRE
AI
H
H M Dipu Kabir *
A
Abbas Khosravi
S
Subrota Kumar Mondal
S
Saeid Nahavandi
U
U. Rajendra Acharya
DOI:10.1016/j.compbiomed.2022.105246delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The user does not have any idea about the credibility of outcomes from deep neural networks (DNN) when uncertainty quantification (UQ) is not employed. However, current Deep UQ classification models capture mostly epistemic uncertainty. Therefore, this paper aims to propose an aleatory-aware Deep UQ method for classifi-cation problems. First, we train DNNs through transfer learning and collect numeric output posteriors for all training samples instead of logical outputs. Then we determine the probability of happening a certain class from K-nearest output posteriors of the same DNN in training samples. We name this probability as opacity score, as the paper focuses on the detection of opacity on X-ray images. This score reflects the level of aleatory on the sample. When the NN is certain on the classification of the sample, the probability of happening a class becomes much higher than the probabilities of others. Probabilities for different classes become close to each other for a highly uncertain classification outcome. To capture the epistemic uncertainty, we train multiple DNNs with different random initializations, model selection, and augmentations to observe the effect of these training pa-rameters on prediction and uncertainty. To reduce execution time, we first obtain features from the pre-trained NN. Then we apply features to the ensemble of fully connected layers to get the distribution of opacity score during the test. We also train several ResNet and DenseNet DNNs to observe the effect of model selection on prediction and uncertainty. The paper also demonstrates a patient referral framework based on the proposed uncertainty quantification. The scripts of the proposed method are available at the following link: https://github. com/dipuk0506/Aleatory-aware-UQ.
Keyword:
Patient referral
Uncertainty
COVID
Aleatoric
Epistemic
Heteroscedastic

期刊

Computers in Biology and Medicine 封面图
Computers in Biology and Medicine
IF:
6.3
论文数:
8.3K
被引数:
3.3W

机构

H
Harvard University
学者数:
26.5W
论文数: 22.0W
被引数: 28.7W
A
asia university taiwan
学者数:
2.0K
论文数: 2.8K
被引数: 5
D
Deakin University
学者数:
2.0W
论文数: 2.1W
被引数: 2.8W
学者 查看更多机构
引用论文

引用论文

XMVB 2.0: A new version of Xiamen valence bond program
err2014-12-20
err0
PREAI
errZhenhua Chen; Fuming Ying; Xun Chen; Jinshuai Song; Peifeng Su; Lingchun Song; Yirong Mo; Qianer Zhang; Wei Wu
err分享
err收藏
Visualizing Uncertainty About the Future
errSCIENCE
IF45.8
err2011-09-09
err471
PREAI
errSpiegelhalter, David; Pearson, Mike; Short, Ian
err分享
err收藏
Differences and Similarities in Insular and Temporal Pole MRI Gray Matter Volume Abnormalities in First-Episode Schizophrenia and Affective Psychosis
err2003-11-01
err0
errOAAI
errKiyoto Kasai; Martha E. Shenton; Dean F. Salisbury; Toshiaki Onitsuka; Sarah K. Toner; Deborah Yurgelun-Todd; Ron Kikinis; Ferenc A. Jolesz; Robert W. McCarley
err分享
err收藏
Optimal uncertainty-guided neural network training
err2021-02-01
err21
errOAAI
errKabir, H. M. Dipu; Khosravi, Abbas; Kavousi-Fard, Abdollah; Nahavandi, Saeid; Srinivasan, Dipti
err分享
err收藏
An Uncertainty-Aware Transfer Learning-Based Framework for COVID-19 Diagnosis基于不确定性感知迁移学习的新型冠状病毒肺炎诊断框架
err2021-04-01
err84
errOAAI
errShamsi, Afshar; Asgharnezhad, Hamzeh; Jokandan, Shirin Shamsi; Khosravi, Abbas; Kebria, Parham M.; Nahavandi, Darius; Nahavandi, Saeid; Srinivasan, Dipti
err分享
err收藏
The emergence of artistic ability following traumatic brain injury
err2014-01-14
err0
errOAAI
errAkira Midorikawa; Mitsuru Kawamura
err分享
err收藏
学者 查看更多内容