arrow
返回

SLOVA: Uncertainty estimation using single label one-vs-all classifier

delete2022-09-01
delete4
delete
OA
AI
B
Bartosz Wójcik *
J
Jacek Grela
M
Marek Śmieja
K
Krzysztof Misztal
J
Jacek Tabor
DOI:10.1016/j.asoc.2022.109219delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Deep neural networks present impressive performance, yet they cannot reliably estimate their predictive confidence, limiting their applicability in high-risk domains. We show that applying a multi -label one-vs-all loss reveals classification ambiguity and reduces model overconfidence. The introduced SLOVA (Single Label One-Vs-All) model redefines typical one-vs-all predictive probabilities to a single label situation, where only one class is the correct answer. The proposed classifier is confident only if a single class has a high probability and other probabilities are negligible. Unlike the typical softmax function, SLOVA naturally detects out-of-distribution samples if the probabilities of all other classes are small. The model is additionally fine-tuned with exponential calibration, which allows us to precisely align the confidence score with model accuracy. We verify our approach on three tasks. First, we demonstrate that SLOVA is competitive with the state-of-the-art on in-distribution calibration. Second, the performance of SLOVA is robust under dataset shifts. Finally, our approach performs extremely well in the detection of out-of-distribution samples. Consequently, SLOVA is a tool that can be used in various applications where uncertainty modeling is required. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Uncertainty
One-vs-all
Calibration
Distribution shift
Out-of-distribution
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

J
jagiellonian university
学者数:
2.3W
论文数: 1.8W
被引数: 11
引用论文

引用论文

Cobalt‐Catalyzed Multi‐Component Reactions: Recent Advances and Perspectives in Organic Synthesis
err2020-07-01
err0
PREAI
errG. S. Susan Treesa; Mohan Neetha; Salim Saranya; Gopinathan Anilkumar
err分享
err收藏
err分享
err收藏
A novel PKLR gene mutation identified using advanced molecular techniques
err2018-01-18
err0
PREAI
errYunyan He; Jianming Luo; Yonghong Lei; Siyuan Jia; Ning Liao
err分享
err收藏
Emergence of antiferromagnetic ordering in Mn clusters
err2003-06-20
err0
PREAI
errP. Bobadova-Parvanova; K. A. Jackson; S. Srinivas; M. Horoi
err分享
err收藏
学者 查看更多内容