arrow
返回

Interaction Difference Hypothesis Test for Prediction Models

delete2024-06-14
delete0
delete
OA
AI
W
Welchowski, Thomas *
D
Dominic Edelmann
DOI:10.3390/make6020061delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Machine learning research focuses on the improvement of prediction performance. Progress was made with black-box models that flexibly adapt to the given data. However, due to their increased complexity, black-box models are more difficult to interpret. To address this issue, techniques for interpretable machine learning have been developed, yet there is still a lack of methods to reliably identify interaction effects between predictors under uncertainty. In this work, we present a model-agnostic hypothesis test for the identification of interaction effects in black-box machine learning models. The test statistic is based on the difference between the variance of the estimated prediction function and a version of the estimated prediction function without interaction effects derived via partial dependence functions. The properties of the proposed hypothesis test were explored in simulations of linear and nonlinear models. The proposed hypothesis test can be applied to any black-box prediction model, and the null hypothesis of the test can be flexibly specified according to the research question of interest. Furthermore, the test is computationally fast to apply, as the null distribution does not require the resampling or refitting of black-box prediction models.
Keyword:
prediction models
interpretable machine learning
model-agnostic
hypothesis tests
interaction effects

期刊

M
Machine Learning and Knowledge Extraction
IF:
6
论文数:
827
被引数:
1.8K

机构

U
university of bonn
学者数:
3.3W
论文数: 2.6W
被引数: 29
H
Helmholtz Association
学者数:
13.2W
论文数: 10.7W
被引数: 145
引用论文

引用论文

Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges超参数优化: 基础、算法、最佳实践和开放挑战
err2023-01-16
err243
errOAAI
errBischl, Bernd; Binder, Martin; Lang, Michel; Pielok, Tobias; Richter, Jakob; Coors, Stefan; Thomas, Janek; Ullmann, Theresa; Becker, Marc; Boulesteix, Anne-Laure; Deng, Difan; Lindauer, Marius
err分享
err收藏
Molecular and Pathogenic Variation Identified Among Isolates of Corynespora cassiicola
err2008-10-08
err0
PREAI
errYanxiang Qi; Yixian Xie; Xin Zhang; Jinji Pu; Huiqiang Zhang; Siliang Huang; He Zhang
err分享
err收藏
Efficacy and safety of danoprevir plus sofosbuvir in GT 1, 2, 3, or 6 chronic hepatitis C patients with or without cirrhosis in China
err2021-06-18
err0
errOAAI
errShufang Pan; Kai Feng; Ping Huang; Yingfu Zeng; Liu Ke; Xiaodong Yang; Jing Liu; Chaoshuang Lin
err分享
err收藏
学者 查看更多内容