.png){kind=icon}
Return
A novel model usability evaluation framework (MUsE) for explainable artificial intelligence
.png){kind=icon}
PRE
AI
DOI：10.1016/j.inffus.2021.11.017.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
When it comes to complex machine learning models, commonly referred to as black boxes, understanding the underlying decision making process is crucial for domains such as healthcare and financial services, as well as when they are used in connection with safety critical systems such as autonomous vehicles. As a result, interest in explainable artificial intelligence (xAI) tools and techniques has increased in recent years. However, the user experience (UX) effectiveness of existing xAI frameworks, especially concerning algorithms that work with data as opposed to images, is still an open research question. In order to address this gap, we examine the UX effectiveness of the Local Interpretable Model-Agnostic Explanations (LIME) xAI framework, one of the most popular model agnostic frameworks found in the literature, with a specific focus on its performance in terms of making tabular models more interpretable. In particular, we apply several state of the art machine learning algorithms on a tabular dataset, and demonstrate how LIME can be used to supplement conventional performance assessment methods. Based on this experience, we evaluate the understandability of the output produced by LIME both via a usability study, involving participants who are not familiar with LIME, and its overall usability via a custom made assessment framework, called Model Usability Evaluation (MUsE), which is derived from the International Organisation for Standardisation 9241-11:2018 standard.
Keywords:
Machine learning
Explainable artificial intelligence
Model agnostic explanations
Usability study
User experience
Journal
IF:
15.5
Papers:
4.3K
Citations:
2.7W
Organization
Cited Papers
Impact of Elotuzumab Plus Pomalidomide/Dexamethasone on Health-Related Quality of Life for Patients with Relapsed/Refractory Multiple Myeloma (RRMM): Final Data from the Phase 2 ELOQUENT-3 Trial.png)
Blood
OAAI
BloodIF0
OAAIShareSaveA study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretabilitySOFT COMPUTING
SOFT COMPUTINGIF2.5
PREAI
ShareSave
ShareSaveShareSave
View more