arrow
Return

Reliable and explainable machine-learning methods for accelerated material discovery

delete2019-11-14
delete123
delete
OA
AI
B
Bhavya Kailkhura *
B
Brian Gallagher
S
Sookyung Kim
A
Anna M. Hiszpanski
T
T. Yong-Jin Han *
DOI:10.1038/s41524-019-0248-2delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Despite ML's impressive performance in commercial applications, several unique challenges exist when applying ML in materials science applications. In such a context, the contributions of this work are twofold. First, we identify common pitfalls of existing ML techniques when learning from underrepresented/imbalanced material data. Specifically, we show that with imbalanced data, standard methods for assessing quality of ML models break down and lead to misleading conclusions. Furthermore, we find that the model's own confidence score cannot be trusted and model introspection methods (using simpler models) do not help as they result in loss of predictive performance (reliability-explainability trade-off). Second, to overcome these challenges, we propose a general-purpose explainable and reliable machine-learning framework. Specifically, we propose a generic pipeline that employs an ensemble of simpler models to reliably predict material properties. We also propose a transfer learning technique and show that the performance loss due to models' simplicity can be overcome by exploiting correlations among different material properties. A new evaluation metric and a trust score to better quantify the confidence in the predictions are also proposed. To improve the interpretability, we add a rationale generator component to our framework which provides both model-level and decision-level explanations. Finally, we demonstrate the versatility of our technique on two applications: (1) predicting properties of crystalline compounds and (2) identifying potentially stable solar cell materials. We also point to some outstanding issues yet to be resolved for a successful application of ML in material science.
Keywords:
CRYSTAL-STRUCTURE
DESIGN
PREDICTION
VALIDATION
MODELS

Journal

npj Computational Materials cover
npj Computational Materials
IF:
11.9
Papers:
2.4K
Citations:
1.7W

Organization

L
Lawrence Livermore National Laboratory
Scholars:
6.0K
Papers: 3.8K
Citations: 9
U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
Cited Papers

Cited Papers

Synthesis and structure of free-standing germanium quantum dots and their application in live cell imaging
err2015-01-01
err0
errOAAI
errAli Karatutlu; Mingying Song; Ann P. Wheeler; Osman Ersoy; William R. Little; Yuanpeng Zhang; Pascal Puech; Filippo S. Boi; Zofia Luklinska; Andrei V. Sapelkin
errShare
errSave
Survey on deep learning with class imbalance
err2019-03-19
err1.5K
errOAAI
errJohnson, Justin M.; Khoshgoftaar, Taghi M.
errShare
errSave
Analysis of Phagosomal Antigen Degradation by Flow Organellocytometry
err2016-01-01
err0
errOAAI
errEik Hoffmann; Anne-Marie Pauwels; Andrés Alloatti; Fiorella Kotsias; Sebastian Amigorena
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
errShare
errSave
A general-purpose machine learning framework for predicting properties of inorganic materials
err2016-08-26
err1.2K
errOAAI
errWard, Logan; Agrawal, Ankit; Choudhary, Alok; Wolverton, Christopher
errShare
errSave
Robust Optimization of Power Consumption for Public Buildings Considering Forecasting Uncertainty of Environmental Factors
err2018-11-08
err0
errOAAI
errJingshu Xiao; Jun Xie; Xingying Chen; Kun Yu; Zhenyu Chen; Kaining Luan
errShare
errSave
Informatics-aided bandgap engineering for solar materials
err2014-02-01
err149
PREAI
errDey, Partha; Bible, Joe; Datta, Somnath; Broderick, Scott; Jasinski, Jacek; Sunkara, Mahendra; Menon, Madhu; Rajan, Krishna
errShare
errSave
researcher View more