arrow
Return

Shapley variable importance cloud for interpretable machine learning

delete2022-04-01
delete47
delete
OA
AI
Y
Yilin Ning
M
Marcus Eng Hock Ong
B
Bibhas Chakraborty
B
Benjamin A. Goldstein
D
Daniel Shu Wei Ting
R
R. S. Vaughan
N
Nan Liu *
DOI:10.1016/j.patter.2022.100452delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Interpretable machine learning has been focusing on explaining final models that optimize performance. The state-of-the-art Shapley additive explanations (SHAP) locally explains the variable impact on individual predictions and has recently been extended to provide global assessments across the dataset. Our work further extends global'' assessments to a set of models that are good enough'' and are practically as relevant as the final model to a prediction task. The resulting Shapley variable importance cloud consists of Shapleybased importance measures from each good model and pools information across models to provide an overall importance measure, with uncertainty explicitly quantified to support formal statistical inference. We developed visualizations to highlight the uncertainty and to illustrate its implications to practical inference. Building on a common theoretical basis, our method seamlessly complements the widely adopted SHAP assessments of a single final model to avoid biased inference, which we demonstrate in two experiments using recidivism prediction data and clinical data.
Keywords:
DIABETIC-RETINOPATHY
MODELS
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Patterns cover
Patterns
IF:
7.4
Papers:
940
Citations:
3.6K

Organization

N
National University of Singapore
Scholars:
7.5W
Papers: 6.5W
Citations: 11.4W
Cited Papers

Cited Papers

Towards multi-modal causability with Graph Neural Networks enabling information fusion for explainable AI
err2021-07-01
err218
errOAAI
errHolzinger, Andreas; Malle, Bernd; Saranti, Anna; Pfeifer, Bastian
errShare
errSave
A historical perspective of explainable Artificial Intelligence
err2020-10-19
err175
errOAAI
errConfalonieri, Roberto; Coba, Ludovik; Wagner, Benedikt; Besold, Tarek R.
errShare
errSave
errShare
errSave
Interpretable machine learning: Fundamental principles and 10 grand challenges
err2022-01-01
err290
errOAAI
errRudin, Cynthia; Chen, Chaofan; Chen, Zhi; Huang, Haiyang; Semenova, Lesia; Zhong, Chudi
errShare
errSave
A basic introduction to fixed-effect and random-effects models for meta-analysis
err2010-11-21
err4.7K
PREAI
errBorenstein, Michael; Hedges, Larry V.; Higgins, Julian P. T.; Rothstein, Hannah R.
errShare
errSave
Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes
err2017-12-12
err1.4K
errOAAI
errTing, Daniel Shu Wei; Cheung, Carol Yim-Lui; Lim, Gilbert; Tan, Gavin Siew Wei; Quang, Nguyen D.; Gan, Alfred; Hamzah, Haslina; Garcia-Franco, Renata; Yeo, Ian Yew San; Lee, Shu Yen; Wong, Edmund Yick Mun; Sabanayagam, Charumathi; Baskaran, Mani; Ibrahim, Farah; Tan, Ngiap Chuan; Finkelstein, Eric A.; Lamoureux, Ecosse L.; Wong, Ian Y.; Bressler, Neil M.; Sivaprasad, Sobha; Varma, Rohit; Jonas, Jost B.; He, Ming Guang; Cheng, Ching-Yu; Cheung, Gemmy Chui Ming; Aung, Tin; Hsu, Wynne; Lee, Mong Li; Wong, Tien Yin
errShare
errSave
researcher View more