arrow
Return

Enabling deeper learning on big data for materials informatics applications

delete2021-02-19
delete39
delete
OA
AI
D
Dipendra Jha
V
Vishu Gupta
L
Logan Ward
Z
Zijiang Yang
C
Christopher Wolverton
I
Ian Foster
廖维 cover
廖维 (Wei‐keng Liao)
A
Alok Choudhary
A
Ankit Agrawal *
DOI:10.1038/s41598-021-83193-1delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The application of machine learning (ML) techniques in materials science has attracted significant attention in recent years, due to their impressive ability to efficiently extract data-driven linkages from various input materials representations to their output properties. While the application of traditional ML techniques has become quite ubiquitous, there have been limited applications of more advanced deep learning (DL) techniques, primarily because big materials datasets are relatively rare. Given the demonstrated potential and advantages of DL and the increasing availability of big materials datasets, it is attractive to go for deeper neural networks in a bid to boost model performance, but in reality, it leads to performance degradation due to the vanishing gradient problem. In this paper, we address the question of how to enable deeper learning for cases where big materials data is available. Here, we present a general deep learning framework based on Individual Residual learning (IRNet) composed of very deep neural networks that can work with any vector-based materials representation as input to build accurate property prediction models. We find that the proposed IRNet models can not only successfully alleviate the vanishing gradient problem and enable deeper learning, but also lead to significantly (up to 47%) better model accuracy as compared to plain deep neural networks and traditional ML techniques for a given input materials representation in the presence of big data.
Keywords:
MATERIALS SCIENCE
FRAMEWORK
NETWORKS
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
27.8W
Citations:
83.5W

Organization

A
Argonne National Laboratory
Scholars:
1.1W
Papers: 9.2K
Citations: 3.8W
U
university of chicago
Scholars:
4.4W
Papers: 3.7W
Citations: 80
N
Northwestern University
Scholars:
6.1W
Papers: 5.3W
Citations: 3.9K
researcher View more organizations