arrow
返回

Interpretable confidence measures for decision support systems

delete2020-12-01
delete43
delete
OA
AI
J
Jasper van der Waa *
T
Tjeerd Schoonderwoerd
J
Jurriaan van Diggelen
M
Mark A. Neerincx
DOI:10.1016/j.ijhcs.2020.102493delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Decision support systems (DSS) have improved significantly but are more complex due to recent advances in Artificial Intelligence. Current XAI methods generate explanations on model behaviour to facilitate a user's understanding, which incites trust in the DSS. However, little focus has been on the development of methods that establish and convey a system's confidence in the advice that it provides. This paper presents a framework for Interpretable Confidence Measures (ICMs). We investigate what properties of a confidence measure are desirable and why, and how an ICM is interpreted by users. In several data sets and user experiments, we evaluate these ideas. The presented framework defines four properties: 1) accuracy or soundness, 2) transparency, 3) explainability and 4) predictability. These characteristics are realized by a case-based reasoning approach to confidence estimation. Example ICMs are proposed for-and evaluated onmultiple data sets. In addition, ICM was evaluated by performing two user experiments. The results show that ICM can be as accurate as other confidence measures, while behaving in a more predictable manner. Also, ICM's underlying idea of case-based reasoning enables generating explanations about the computation of the confidence value, and facilitates user's understandability of the algorithm.
Keyword:
Machine learning
Decision support systems
Confidence
Explainable AI
Artificial intelligence
Transparency
Interpretable
User study
Interpretable machine learning
Trust calibration
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
International Journal of Human-Computer Studies
IF:
5.1
论文数:
2.9K
被引数:
8.9K

机构

N
Netherlands Organization Applied Science Research
学者数:
4.6K
论文数: 3.4K
被引数: 3
引用论文

引用论文

UNDERSTANDING CONDITIONAL PROBABILITIES
err1987-10-01
err41
PREAI
errPOLLATSEK, A; WELL, AD; KONOLD, C; HARDIMAN, P
err分享
err收藏
err分享
err收藏
Intuitive expertise: Theories and empirical evidence
err2013-06-01
err46
PREAI
errHarteis, Christian; Billett, Stephen
err分享
err收藏
err分享
err收藏
Age-related increases in cardiac excitability, refractoriness and impulse conduction favor arrhythmogenesis in male rats
err2023-04-06
err0
PREAI
errStefano Rossi; Rosario Statello; Giovanna Pelà; Fabio Leonardi; Aderville Cabassi; Ruben Foresti; Giacomo Rozzi; Francesco Paolo Lo Muzio; Luca Carnevali; Andrea Sgoifo; Luca Magnani; Sergio Callegari; Paolo Pastori; Alessandro Tafuni; Domenico Corradi; Michele Miragoli; Emilio Macchi
err分享
err收藏
学者 查看更多内容