arrow
Return

Explainability of machine learning models under missing data

delete2026-03-23
delete0
PRE
AI
T
Tuan L. Vo *
T
Thu Nguyen
L
Luis M. López-Ramos
H
Hugo L. Hammer
M
Michael A. Riegler
P
Pål Halvorsen
DOI:10.1016/j.asoc.2026.115105delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• Impact of imputation on model explainability: Different imputation methods significantly influence Shapley values, affecting feature importance and interaction explanations derived from machine learning models. • Trade-off between prediction accuracy and explainability: A lower test prediction Mean Squared Error (MSE) does not necessarily correspond to a lower MSE in Shapley values, highlighting a trade-off between imputation accuracy and explainability preservation. • Dataset and missing rate dependency: The effects of imputation methods on Shapley values vary across datasets and become more pronounced as the missing data rate increases, emphasizing the need for context-specific imputation strategies. • Limitations of direct missing data handling in XGBoost: While XGBoost can handle missing data directly, it often distorts Shapley values more significantly compared to using imputed data, raising concerns about explainability. • Practical guidance for imputation method selection: This study offers insights and recommendations for selecting imputation methods based on dataset characteristics, missing rates, and the trade-off between accuracy and explainability.
Keywords:
Imputation methods
Shapley values
Model explainability
Missing data
Feature importance

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

S
simulamet
Scholars:
17
Papers: 8
Citations: 0
T
telecom paris
Scholars:
316
Papers: 259
Citations: 0
Cited Papers

Cited Papers

Estimation of missing values in heterogeneous traffic data: Application of multimodal deep learning model
err2020-04-01
err68
PREAI
errLi, Linchao; Du, Bowen; Wang, Yonggang; Qin, Lingqiao; Tan, Huachun
errShare
errSave
Missing data imputation with adversarially-trained graph convolutional networks
err2020-09-01
err97
errOAAI
errSpinelli, Indro; Scardapane, Simone; Uncini, Aurelio
errShare
errSave
Missing Data Imputation for Industrial Time Series With Adaptive Median Iteration Based on Generative Adversarial Networks
err2024-11-01
err5
PREAI
errYuan, Xiaofeng; Zhang, Jiale; Wang, Kai; Wang, Yalin; Yang, Chunhua; Gui, Weihua; Shen, Feifan; Ye, Lingjian
errShare
errSave
Long Short-Term Memory
err1997-11-01
err0
PREAI
errSepp Hochreiter; Jürgen Schmidhuber
errShare
errSave
Missing-Data Imputation With Position-Encoding Denoising Autoencoders for Industrial Processes
err2024-01-01
err2
PREAI
errOu, Chen; Zhu, Hongqiu; Shardt, Yuri A. W.; Ye, Lingjian; Yuan, Xiaofeng; Wang, Yalin; Yang, Chunhua; Gui, Weihua
errShare
errSave
Imputation of missing data with neural networks for classification
err2019-10-01
err77
PREAI
errChoudhury, Suyra Jyoti; Pal, Nikhil R.
errShare
errSave
AI in health and medicine
err2022-01-20
err859
PREAI
errRajpurkar, Pranav; Chen, Emma; Banerjee, Oishi; Topol, Eric J.
errShare
errSave
EPEM: Efficient Parameter Estimation for Multiple Class Monotone Missing Data
err2021-08-01
err0
errOAAI
errThu Nguyen; Duy H.M. Nguyen; Huy Nguyen; Binh T. Nguyen; Bruce A. Wade
errShare
errSave
Clustering mixed numerical and categorical data with missing values
err2021-09-01
err0
errOAAI
errDuy-Tai Dinh; Van-Nam Huynh; Songsak Sriboonchitta
errShare
errSave
researcher View more