.png){kind=icon}
返回
An interpretable automated feature engineering framework for improving logistic regression
.png){kind=icon}
PRE
AI
DOI：10.1016/j.asoc.2024.111269.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Although black -box models such as ensemble learning models often provide better predictive performance than intrinsic interpretable models such as logistic regression, black -box models are not still applicable due to the lack of interpretability. Recently, there has been an explosion of work on explainable machine learning techniques, which utilize external algorithms or models to explain the behavior of black -box models. However, it is problematic to explain the black -box model behavior because the explanation provided might not reveal the real mechanism or decision process of black -box models. In this study, instead of using explainable machine learning techniques, an automated feature engineering task was formulated to help logistic regression achieve predictive performance comparable to or even better than black -box models while maintaining interpretability. In this paper, an INterpretable Automated Feature ENgineering (INAFEN) framework was designed for logistic regression. This framework automatically transforms the nonlinear relationships between numerical features and labels into linear relationships, conducts feature cross through association rule mining, and distills knowledge from black -box models. A case study was performed on gastric survival prediction to present the rationality of the feature transformations through INAFEN and benchmark experiments to show the validity of INAFEN. Experimental results on 10 classification tasks demonstrated that INAFEN achieved an average ranking of 2.60 in area under the ROC curve (AUROC), 3.35 in area under the PR curve (AUROC), 3.70 in F1 score and 3.00 in Brier score (among 13 models), outperforming other interpretable baselines and even black -box models. In addition, the interpretability measurement of INAFEN is significantly better than that of black -box models.
Keyword:
Interpretable machine learning
Feature engineering
Automated machine learning
Knowledge distillation
期刊
IF:
6.6
论文数:
1.4W
被引数:
4.8W
机构
引用论文
Interpretable machine learning: Fundamental principles and 10 grand challenges可解释的机器学习: 基本原则和十大挑战.png)
STATISTICS SURVEYS
OAAI
STATISTICS SURVEYSIF15.4
OAAI分享收藏Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead停止解释高风险决策的黑盒机器学习模型，而改用可解释的模型
OAAI
OAAI分享收藏A review of uncertainty quantification in deep learning: Techniques, applications and challenges深度学习中的不确定性量化: 技术、应用与挑战INFORMATION FUSIONOAAI
INFORMATION FUSIONIF15.5
OAAI分享收藏A multi-level classification and modified PSO clustering based ensemble approach for credit scoring
PREAI
分享收藏
查看更多内容