arrow
Return

DPA-2: a large atomic model as a multi-task learner

delete2024-12-19
delete0
delete
OA
AI
D
Duo Zhang
X
Xinzijian Liu
张
张祥宇 (Xiangyu Zhang)
C
Chengqian Zhang
C
Chun Cai
H
Hangrui Bi
Y
Yiming Du
X
Xuejian Qin
A
Anyang Peng
J
Jiameng Huang
B
Bowen Li
Y
Yifan Shan
J
Jinzhe Zeng
Y
Yuzhi Zhang
刘
刘思远 (Siyuan Liu)
Y
Yifan Li
J
Junhan Chang
X
Xinyan Wang
S
Shuo Zhou
刘建川 cover
刘建川 (Jianchuan Liu)
X
Xiaoshan Luo
Z
Zhenyu Wang
W
Wanrun Jiang
J
Jing Wu
Y
Yudi Yang
J
Jiyuan Yang
M
Manyi Yang
F
Fu‐Qiang Gong
L
Linshuang Zhang
M
Mengchao Shi
F
Fu‐Zhi Dai
D
Darrin M. York
S
Shi Liu
朱
朱彤 (Tong Zhu)
钟
钟志成 (Zhicheng Zhong)
J
Jian Lv
程
程军 (Jun Cheng)
W
Weile Jia
陈默涵 cover
陈默涵 (Mohan Chen)
G
Guolin Ke
E Weinan cover
E Weinan (E Weinan)
L
Linfeng Zhang *
W
Wang, Han *
DOI:10.1038/s41524-024-01493-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The rapid advancements in artificial intelligence (AI) are catalyzing transformative changes in atomic modeling, simulation, and design. AI-driven potential energy models have demonstrated the capability to conduct large-scale, long-duration simulations with the accuracy of ab initio electronic structure methods. However, the model generation process remains a bottleneck for large-scale applications. We propose a shift towards a model-centric ecosystem, wherein a large atomic model (LAM), pre-trained across multiple disciplines, can be efficiently fine-tuned and distilled for various downstream tasks, thereby establishing a new framework for molecular modeling. In this study, we introduce the DPA-2 architecture as a prototype for LAMs. Pre-trained on a diverse array of chemical and materials systems using a multi-task approach, DPA-2 demonstrates superior generalization capabilities across multiple downstream tasks compared to the traditional single-task pre-training and fine-tuning methodologies. Our approach sets the stage for the development and broad application of LAMs in molecular and materials simulation research.
Keywords:
TOTAL-ENERGY CALCULATIONS

Journal

npj Computational Materials cover
npj Computational Materials
IF:
11.9
Papers:
2.4K
Citations:
1.7W

Organization

No organization information available
Cited Papers

Cited Papers

E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials
err2022-05-04
err648
errOAAI
errBatzner, Simon; Musaelian, Albert; Sun, Lixin; Geiger, Mario; Mailoa, Jonathan P.; Kornbluth, Mordechai; Molinari, Nicola; Smidt, Tess E.; Kozinsky, Boris
errShare
errSave
Fe–N bonding in a carbon nanotube–graphene complex for oxygen reduction: an XAS study
err2014-06-25
err0
PREAI
errJigang Zhou; Paul N. Duchesne; Yongfeng Hu; Jian Wang; Peng Zhang; Yanguang Li; Tom Regier; Hongjie Dai
errShare
errSave
Background risk and recent experience influences retention of neophobic responses to predators
err2015-02-24
err0
PREAI
errGrant E. Brown; Chris K. Elvidge; Indar Ramnarine; Maud C. O. Ferrari; Douglas P. Chivers
errShare
errSave
Masking vs. Multiparty Computation: How Large Is the Gap for AES?
err2013-01-01
err0
PREAI
errVincent Grosso; François-Xavier Standaert; Sebastian Faust
errShare
errSave
Deep potential generation scheme and simulation protocol for the Li10GeP2S12-type superionic conductors
err2021-03-01
err70
errOAAI
errHuang, Jianxing; Zhang, Linfeng; Wang, Han; Zhao, Jinbao; Cheng, Jun; Weinan, E.
errShare
errSave
Approaching coupled cluster accuracy with a general-purpose neural network potential through transfer learning
err2019-07-01
err486
errOAAI
errSmith, Justin S.; Nebgen, Benjamin T.; Zubatyuk, Roman; Lubbers, Nicholas; Devereux, Christian; Barros, Kipton; Tretiak, Sergei; Isayev, Olexandr; Roitberg, Adrian E.
errShare
errSave
Pretraining of attention-based deep learning potential model for molecular simulation
err2024-05-07
err15
errOAAI
errZhang, Duo; Bi, Hangrui; Dai, Fu-Zhi; Jiang, Wanrun; Liu, Xinzijian; Zhang, Linfeng; Wang, Han
errShare
errSave
researcher View more