.png){kind=icon}
返回
A novel model usability evaluation framework (MUsE) for explainable artificial intelligence
.png){kind=icon}
PRE
AI
DOI：10.1016/j.inffus.2021.11.017.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
When it comes to complex machine learning models, commonly referred to as black boxes, understanding the underlying decision making process is crucial for domains such as healthcare and financial services, as well as when they are used in connection with safety critical systems such as autonomous vehicles. As a result, interest in explainable artificial intelligence (xAI) tools and techniques has increased in recent years. However, the user experience (UX) effectiveness of existing xAI frameworks, especially concerning algorithms that work with data as opposed to images, is still an open research question. In order to address this gap, we examine the UX effectiveness of the Local Interpretable Model-Agnostic Explanations (LIME) xAI framework, one of the most popular model agnostic frameworks found in the literature, with a specific focus on its performance in terms of making tabular models more interpretable. In particular, we apply several state of the art machine learning algorithms on a tabular dataset, and demonstrate how LIME can be used to supplement conventional performance assessment methods. Based on this experience, we evaluate the understandability of the output produced by LIME both via a usability study, involving participants who are not familiar with LIME, and its overall usability via a custom made assessment framework, called Model Usability Evaluation (MUsE), which is derived from the International Organisation for Standardisation 9241-11:2018 standard.
Keyword:
Machine learning
Explainable artificial intelligence
Model agnostic explanations
Usability study
User experience
期刊
IF:
15.5
论文数:
4.3K
被引数:
2.7W
机构
引用论文
Impact of Elotuzumab Plus Pomalidomide/Dexamethasone on Health-Related Quality of Life for Patients with Relapsed/Refractory Multiple Myeloma (RRMM): Final Data from the Phase 2 ELOQUENT-3 Trial.png)
Blood
OAAI
BloodIF0
OAAI分享收藏A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability基于遗传学的机器学习的统计技术和性能度量的研究: 准确性和可解释性SOFT COMPUTING
SOFT COMPUTINGIF2.5
PREAI
分享收藏The response of rectangular piezoelectric sensors to Rayleigh and Lamb ultrasonic waves矩形压电传感器对瑞利和兰姆超声波的响应
OAAI
OAAI分享收藏Cell-free Protein Synthesis in an Autoinduction System for NMR Studies of Protein–Protein Interactions用于NMR研究蛋白质-蛋白质相互作用的自动诱导系统中的无细胞蛋白质合成
PREAI
分享收藏
查看更多内容