返回
Interpretable models for extrapolation in scientific machine learning
DOI:10.1039/d3dd00082f.png)
摘要
En 中文
Data-driven models are central to scientific discovery. In efforts to achieve state-of-the-art model accuracy, researchers are employing increasingly complex machine learning algorithms that often outperform simple regressions in interpolative settings (e.g. random k-fold cross-validation) but suffer from poor extrapolation performance, portability, and human interpretability, which limits their potential for facilitating novel scientific insight. Here we examine the trade-off between model performance and interpretability across a broad range of science and engineering problems with an emphasis on materials science datasets. We compare the performance of black box random forest and neural network machine learning algorithms to that of single-feature linear regressions which are fitted using interpretable input features discovered by a simple random search algorithm. For interpolation problems, the average prediction errors of linear regressions were twice as high as those of black box models. Remarkably, when prediction tasks required extrapolation, linear models yielded average error only 5% higher than that of black box models, and outperformed black box models in roughly 40% of the tested prediction tasks, which suggests that they may be desirable over complex algorithms in many extrapolation problems because of their superior interpretability, computational overhead, and ease of use. The results challenge the common assumption that extrapolative models for scientific machine learning are constrained by an inherent trade-off between performance and interpretability. On average, simple linear models perform equivalently to black box machine learning models on extrapolation tasks.
期刊
IF:
5.6
论文数:
1.0K
被引数:
1.7K
机构
引用论文
Deep learning approaches for mining structure-property linkages in high contrast composites from simulation datasets用于从模拟数据集挖掘高对比度复合材料中的结构-属性联系的深度学习方法
Working memory span tasks: Group administration and omitting accuracy criterion do not change metric characteristics工作记忆跨度任务: 小组管理和省略准确性标准不会改变度量特征
PLOS ONE
IF0
Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead停止解释高风险决策的黑盒机器学习模型,而改用可解释的模型
A general-purpose machine learning framework for predicting properties of inorganic materials用于预测无机材料性能的通用机器学习框架

