arrow
返回

Interpretable Machine Learning for Discovery: Statistical Challenges and Opportunities

delete2024-04-22
delete7
delete
OA
AI
G
Genevera I. Allen *
L
Luqin Gan
L
Lili Zheng
DOI:10.1146/annurev-statistics-040120-030919delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
New technologies have led to vast troves of large and complex data sets across many scientific domains and industries. People routinely use machine learning techniques not only to process, visualize, and make predictions from these big data, but also to make data-driven discoveries. These discoveries are often made using interpretable machine learning, or machine learning models and techniques that yield human-understandable insights. In this article, we discuss and review the field of interpretable machine learning, focusing especially on the techniques, as they are often employed to generate new knowledge or make discoveries from large data sets.We outline the types of discoveries that can be made using interpretable machine learning in both supervised and unsupervised settings. Additionally, we focus on the grand challenge of how to validate these discoveries in a data-driven manner, which promotes trust in machine learning systems and reproducibility in science.We discuss validation both from a practical perspective, reviewing approaches based on data-splitting and stability, as well as from a theoretical perspective, reviewing statistical results on model selection consistency and uncertainty quantification via statistical inference. Finally, we conclude by highlighting open challenges in using interpretable machine learning techniques to make discoveries, including gaps between theory and practice for validating data-driven discoveries.
Keyword:
machine learning
interpretability
explainability
data-driven discoveries
validation
stability
selection consistency
uncertainty quantification

期刊

Annual Review of Statistics and Its Application 封面图
Annual Review of Statistics and Its Application
IF:
8.7
论文数:
211
被引数:
2.4K

机构

R
Rice University
学者数:
1.4W
论文数: 1.2W
被引数: 2.6W
引用论文

引用论文

err分享
err收藏
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications解释深度神经网络及其以后: 方法和应用综述
err2021-03-01
err575
errOAAI
errSamek, Wojciech; Montavon, Gregoire; Lapuschkin, Sebastian; Anders, Christopher J.; Mueller, Klaus-Robert
err分享
err收藏
err分享
err收藏
学者 查看更多内容