arrow
返回

Learning together: Towards foundation models for machine learning interatomic potentials with meta-learning

delete2024-07-17
delete3
delete
OA
AI
A
Alice E. A. Allen *
N
Nicholas Lubbers
S
Sakib Matin
J
Justin S. Smith
R
Richard A. Messerly
S
Sergei Tretiak
K
Kipton Barros
DOI:10.1038/s41524-024-01339-xdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The development of machine learning models has led to an abundance of datasets containing quantum mechanical (QM) calculations for molecular and material systems. However, traditional training methods for machine learning models are unable to leverage the plethora of data available as they require that each dataset be generated using the same QM method. Taking machine learning interatomic potentials (MLIPs) as an example, we show that meta-learning techniques, a recent advancement from the machine learning community, can be used to fit multiple levels of QM theory in the same training process. Meta-learning changes the training procedure to learn a representation that can be easily re-trained to new tasks with small amounts of data. We then demonstrate that meta-learning enables simultaneously training to multiple large organic molecule datasets. As a proof of concept, we examine the performance of a MLIP refit to a small drug-like molecule and show that pre-training potentials to multiple levels of theory with meta-learning improves performance. This difference in performance can be seen both in the reduced error and in the improved smoothness of the potential energy surface produced. We therefore show that meta-learning can utilize existing datasets with inconsistent QM levels of theory to produce models that are better at specializing to new datasets. This opens new routes for creating pre-trained, foundation models for interatomic potentials.
Keyword:
FORCE-FIELD
CHEMISTRY

期刊

npj Computational Materials 封面图
npj Computational Materials
IF:
11.9
论文数:
2.4K
被引数:
1.7W

机构

U
united states department of energy (doe)
学者数:
11.3W
论文数: 9.6W
被引数: 246
L
Los Alamos National Laboratory
学者数:
9.6K
论文数: 6.7K
被引数: 1.9W
引用论文

引用论文

Evidence of synergy between Thy-1 and CD3/TCR complex in signal delivery to murine thymocytes for cell death.
err1991-08-15
err0
errOAAI
errI Nakashima; Y H Zhang; S M Rahman; T Yoshida; K Isobe; L N Ding; T Iwamoto; M Hamaguchi; H Ikezawa; R Taguchi
err分享
err收藏
E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentialsE(3)-等变图神经网络,用于数据高效和精确的原子间势
err2022-05-04
err648
errOAAI
errBatzner, Simon; Musaelian, Albert; Sun, Lixin; Geiger, Mario; Mailoa, Jonathan P.; Kornbluth, Mordechai; Molinari, Nicola; Smidt, Tess E.; Kozinsky, Boris
err分享
err收藏
err分享
err收藏
Music as an auxiliary analgesic during first trimester surgical abortion: a randomized controlled trial
err2012-08-01
err0
PREAI
errJacqueline M. Guerrero; Paula M. Castaño; Elizabeth O. Schmidt; Linette Rosario; Carolyn L. Westhoff
err分享
err收藏
Approaching coupled cluster accuracy with a general-purpose neural network potential through transfer learning通过迁移学习接近具有通用神经网络潜力的耦合聚类精度
err2019-07-01
err486
errOAAI
errSmith, Justin S.; Nebgen, Benjamin T.; Zubatyuk, Roman; Lubbers, Nicholas; Devereux, Christian; Barros, Kipton; Tretiak, Sergei; Isayev, Olexandr; Roitberg, Adrian E.
err分享
err收藏
Less is more: Sampling chemical space with active learning少即多: 通过主动学习对化学空间进行采样
err2018-05-22
err571
errOAAI
errSmith, Justin S.; Nebgen, Ben; Lubbers, Nicholas; Isayev, Olexandr; Roitberg, Adrian E.
err分享
err收藏
A survey of deep meta-learning深度元学习综述
err2021-04-19
err234
errOAAI
errHuisman, Mike; van Rijn, Jan N.; Plaat, Aske
err分享
err收藏
学者 查看更多内容