返回
Interpretable confidence measures for decision support systems
DOI:10.1016/j.ijhcs.2020.102493.png)
摘要
En 中文
Decision support systems (DSS) have improved significantly but are more complex due to recent advances in Artificial Intelligence. Current XAI methods generate explanations on model behaviour to facilitate a user's understanding, which incites trust in the DSS. However, little focus has been on the development of methods that establish and convey a system's confidence in the advice that it provides. This paper presents a framework for Interpretable Confidence Measures (ICMs). We investigate what properties of a confidence measure are desirable and why, and how an ICM is interpreted by users. In several data sets and user experiments, we evaluate these ideas. The presented framework defines four properties: 1) accuracy or soundness, 2) transparency, 3) explainability and 4) predictability. These characteristics are realized by a case-based reasoning approach to confidence estimation. Example ICMs are proposed for-and evaluated onmultiple data sets. In addition, ICM was evaluated by performing two user experiments. The results show that ICM can be as accurate as other confidence measures, while behaving in a more predictable manner. Also, ICM's underlying idea of case-based reasoning enables generating explanations about the computation of the confidence value, and facilitates user's understandability of the algorithm.
Keyword:
Machine learning
Decision support systems
Confidence
Explainable AI
Artificial intelligence
Transparency
Interpretable
User study
Interpretable machine learning
Trust calibration
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
5.1
论文数:
2.9K
被引数:
8.9K
机构
引用论文
Awareness of activity limitations, goal setting and rehabilitation outcome in patients with brain injuries
Brain Injury
IF0
A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms一类懒惰学习算法的特征加权方法综述与实证评价
Solubility Advantage of Pyrazine-2-carboxamide: Application of Alternative Solvents on the Way to the Future Pharmaceutical DevelopmentPyrazine-2-carboxamide的溶解度优势: 替代溶剂在未来药物开发中的应用
Mobile App-Based Interventions to Support Diabetes Self-Management: A Systematic Review of Randomized Controlled Trials to Identify Functions Associated with Glycemic Efficacy基于移动应用的干预措施支持糖尿病自我管理: 对随机对照试验的系统评价,以确定与血糖功效相关的功能

