arrow
Return

Interaction Difference Hypothesis Test for Prediction Models

delete2024-06-14
delete0
delete
OA
AI
W
Welchowski, Thomas *
D
Dominic Edelmann
DOI:10.3390/make6020061delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Machine learning research focuses on the improvement of prediction performance. Progress was made with black-box models that flexibly adapt to the given data. However, due to their increased complexity, black-box models are more difficult to interpret. To address this issue, techniques for interpretable machine learning have been developed, yet there is still a lack of methods to reliably identify interaction effects between predictors under uncertainty. In this work, we present a model-agnostic hypothesis test for the identification of interaction effects in black-box machine learning models. The test statistic is based on the difference between the variance of the estimated prediction function and a version of the estimated prediction function without interaction effects derived via partial dependence functions. The properties of the proposed hypothesis test were explored in simulations of linear and nonlinear models. The proposed hypothesis test can be applied to any black-box prediction model, and the null hypothesis of the test can be flexibly specified according to the research question of interest. Furthermore, the test is computationally fast to apply, as the null distribution does not require the resampling or refitting of black-box prediction models.
Keywords:
prediction models
interpretable machine learning
model-agnostic
hypothesis tests
interaction effects

Journal

M
Machine Learning and Knowledge Extraction
IF:
6
Papers:
830
Citations:
1.8K

Organization

U
university of bonn
Scholars:
3.3W
Papers: 2.6W
Citations: 29
H
Helmholtz Association
Scholars:
13.2W
Papers: 10.7W
Citations: 145
Cited Papers

Cited Papers

errShare
errSave
Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
err2023-01-16
err243
errOAAI
errBischl, Bernd; Binder, Martin; Lang, Michel; Pielok, Tobias; Richter, Jakob; Coors, Stefan; Thomas, Janek; Ullmann, Theresa; Becker, Marc; Boulesteix, Anne-Laure; Deng, Difan; Lindauer, Marius
errShare
errSave
Molecular and Pathogenic Variation Identified Among Isolates of Corynespora cassiicola
err2008-10-08
err0
PREAI
errYanxiang Qi; Yixian Xie; Xin Zhang; Jinji Pu; Huiqiang Zhang; Siliang Huang; He Zhang
errShare
errSave
Efficacy and safety of danoprevir plus sofosbuvir in GT 1, 2, 3, or 6 chronic hepatitis C patients with or without cirrhosis in China
err2021-06-18
err0
errOAAI
errShufang Pan; Kai Feng; Ping Huang; Yingfu Zeng; Liu Ke; Xiaodong Yang; Jing Liu; Chaoshuang Lin
errShare
errSave
IMU Preintegration on Manifold for Efficient Visual-Inertial Maximum-a-Posteriori Estimation
err2015-07-13
err0
errOAAI
errChristian Forster; Luca Carlone; Frank Dellaert; Davide Scaramuzza
errShare
errSave
errShare
errSave
researcher View more