arrow
返回

Interpretable models for extrapolation in scientific machine learning

delete2023-01-01
delete27
delete
OA
AI
E
Eric S. Muckley
J
James E. Saal *
B
Bryce Meredig
C
Christopher S. Roper
J
John H. Martin
DOI:10.1039/d3dd00082fdelete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Data-driven models are central to scientific discovery. In efforts to achieve state-of-the-art model accuracy, researchers are employing increasingly complex machine learning algorithms that often outperform simple regressions in interpolative settings (e.g. random k-fold cross-validation) but suffer from poor extrapolation performance, portability, and human interpretability, which limits their potential for facilitating novel scientific insight. Here we examine the trade-off between model performance and interpretability across a broad range of science and engineering problems with an emphasis on materials science datasets. We compare the performance of black box random forest and neural network machine learning algorithms to that of single-feature linear regressions which are fitted using interpretable input features discovered by a simple random search algorithm. For interpolation problems, the average prediction errors of linear regressions were twice as high as those of black box models. Remarkably, when prediction tasks required extrapolation, linear models yielded average error only 5% higher than that of black box models, and outperformed black box models in roughly 40% of the tested prediction tasks, which suggests that they may be desirable over complex algorithms in many extrapolation problems because of their superior interpretability, computational overhead, and ease of use. The results challenge the common assumption that extrapolative models for scientific machine learning are constrained by an inherent trade-off between performance and interpretability. On average, simple linear models perform equivalently to black box machine learning models on extrapolation tasks.

期刊

Digital Discovery 封面图
Digital Discovery
IF:
5.6
论文数:
1.0K
被引数:
1.7K

机构

H
HRL Laboratories
学者数:
38
论文数: 6
被引数: 0
引用论文

引用论文

Aggressively optimizing validation statistics can degrade interpretability of data-driven materials models
err2021-08-03
err11
PREAI
errLei, Katherine; Joress, Howie; Persson, Nils; Hattrick-Simpers, Jason R.; DeCost, Brian
err分享
err收藏
Identification of advanced spin-driven thermoelectric materials via interpretable machine learning
err2019-10-30
err62
errOAAI
errIwasaki, Yuma; Sawada, Ryohto; Stanev, Valentin; Ishida, Masahiko; Kirihara, Akihiro; Omori, Yasutomo; Someya, Hiroko; Takeuchi, Ichiro; Saitoh, Eiji; Yorozu, Shinichi
err分享
err收藏
学者 查看更多内容