Return
Explainability of machine learning models under missing data
DOI:10.1016/j.asoc.2026.115105.png)
Abstract
En 中文
• Impact of imputation on model explainability: Different imputation methods significantly influence Shapley values, affecting feature importance and interaction explanations derived from machine learning models. • Trade-off between prediction accuracy and explainability: A lower test prediction Mean Squared Error (MSE) does not necessarily correspond to a lower MSE in Shapley values, highlighting a trade-off between imputation accuracy and explainability preservation. • Dataset and missing rate dependency: The effects of imputation methods on Shapley values vary across datasets and become more pronounced as the missing data rate increases, emphasizing the need for context-specific imputation strategies. • Limitations of direct missing data handling in XGBoost: While XGBoost can handle missing data directly, it often distorts Shapley values more significantly compared to using imputed data, raising concerns about explainability. • Practical guidance for imputation method selection: This study offers insights and recommendations for selecting imputation methods based on dataset characteristics, missing rates, and the trade-off between accuracy and explainability.
Keywords:
Imputation methods
Shapley values
Model explainability
Missing data
Feature importance
Journal
IF:
6.6
Papers:
1.4W
Citations:
4.8W
Organization
Cited Papers
Missing Data Imputation for Industrial Time Series With Adaptive Median Iteration Based on Generative Adversarial Networks
IEEE SENSORS JOURNAL
IF4.5

