arrow
Return

dpdata: A Scalable Python Toolkit for Atomistic Machine Learning Data Sets

delete2025-10-01
delete0
PRE
AI
J
Jinzhe Zeng *
P
Peng, Xingliang
Y
Yong‐Bin Zhuang
H
Haidi Wang
Y
Yuan, Fengbo
Z
Zhang, Duo
L
Liu, Renxi
W
Wang, Yingze
T
Tuo, Ping
Z
Zhang, Yuzhi
C
Chen, Yixiao
L
Li, Yifan
N
Nguyen, Cao Thang
H
Huang, Jiameng
P
Peng, Anyang
R
Rynik, Marian
X
Xu, Wei-Hong
Z
Zhang, Zezhong
Z
Zhou, Xu-Yuan
C
Chen, Tao
F
Fan, Jiahao
J
Jiang, Wanrun
L
Li, Bowen
L
Li, Denan
L
Li, Haoxi
L
Liang, Wenshuo
L
Liao, Ruihao
L
Liu, Liping
L
Luo, Chenxing
W
Ward, Logan
W
Wan, Kaiwei
W
Wang, Junjie
X
Xiang, Pan
Z
Zhang, Chengqian
Z
Zhang, Jinchao
Z
Zhou, Rui
Z
Zhu, Jia-Xin
Z
Zhang, Linfeng *
W
Wang, Han *
DOI:10.1021/acs.jcim.5c01767delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Seamless management of atomistic data sets is a critical prerequisite for the successful development and deployment of machine learning potentials (MLPs). Here, we present dpdata, an open-source Python library designed to streamline every aspect of MLP data handling. Built upon a flexible, plugin-based architecture, dpdata supports reading, writing, and converting between a broad range of file formats-from popular quantum-chemistry packages and molecular-dynamics engines to specialized MLP frameworks. Users may define custom data types, formats, drivers, and minimizers, enabling effortless extension to emerging software. Key utilities include automated train-test splitting, coordinate perturbation for active learning, outlier-energy removal, Delta-learning data set generation, error-metric computation, and unit conversion. Through efficient NumPy-backed storage and system-level operations, dpdata achieves significant memory saving and inference speedups over configuration-by-configuration tools such as ASE. We also highlight practical impact, with dpdata used across published studies, for format conversion, data storage, coordinate perturbation, and utilization in other projects for data processing.
Keywords:
MOLECULAR-DYNAMICS

Journal

Journal of Chemical Information and Modeling cover
Journal of Chemical Information and Modeling
IF:
5.3
Papers:
9.1K
Citations:
4.0W

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
E
east china normal university
Scholars:
3.1W
Papers: 2.1W
Citations: 25
B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
N
Nanjing University
Scholars:
7.0K
Papers: 2.6K
Citations: 8.1W
A
Argonne National Laboratory
Scholars:
1.1W
Papers: 9.2K
Citations: 3.8W
P
Princeton University
Scholars:
2.1W
Papers: 2.3W
Citations: 5.1W
U
University of California Berkeley
Scholars:
3.5W
Papers: 2.8W
Citations: 11.3W
C
Comenius University Bratislava
Scholars:
9.0K
Papers: 6.0K
Citations: 4.8K
P
Peking University
Scholars:
1.0W
Papers: 3.8K
Citations: 14.7W
U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
U
University of North Carolina School of Medicine
Scholars:
1.6W
Papers: 1.1W
Citations: 20
I
institute of semiconductors, cas
Scholars:
1.6K
Papers: 1.3K
Citations: 3
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
U
University of North Carolina Chapel Hill
Scholars:
3.9W
Papers: 3.1W
Citations: 46
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Array programming with NumPy
err2020-09-16
err0
errOAAI
errCharles R. Harris; K. Jarrod Millman; Stéfan J. van der Walt; Ralf Gommers; Pauli Virtanen; David Cournapeau; Eric Wieser; Julian Taylor; Sebastian Berg; Nathaniel J. Smith; Robert Kern; Matti Picus; Stephan Hoyer; Marten H. van Kerkwijk; Matthew Brett; Allan Haldane; Jaime Fernández del Río; Mark Wiebe; Pearu Peterson; Pierre Gérard-Marchant; Kevin Sheppard; Tyler Reddy; Warren Weckesser; Hameer Abbasi; Christoph Gohlke; Travis E. Oliphant
errShare
errSave
E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials
err2022-05-04
err648
errOAAI
errBatzner, Simon; Musaelian, Albert; Sun, Lixin; Geiger, Mario; Mailoa, Jonathan P.; Kornbluth, Mordechai; Molinari, Nicola; Smidt, Tess E.; Kozinsky, Boris
errShare
errSave
TorchANI: A Free and Open Source PyTorch-Based Deep Learning Implementation of the ANI Neural Network Potentials
err2020-06-22
err205
errOAAI
errGao, Xiang; Ramezanghorbani, Farhad; Isayev, Olexandr; Smith, Justin S.; Roitberg, Adrian E.
errShare
errSave
Pretraining of attention-based deep learning potential model for molecular simulation
err2024-05-07
err15
errOAAI
errZhang, Duo; Bi, Hangrui; Dai, Fu-Zhi; Jiang, Wanrun; Liu, Xinzijian; Zhang, Linfeng; Wang, Han
errShare
errSave
Fast plane wave density functional theory molecular dynamics calculations on multi-GPU machines
err2013-10-01
err361
PREAI
errJia, Weile; Fu, Jiyun; Cao, Zongyan; Wang, Long; Chi, Xuebin; Gao, Weiguo; Wange, Lin-Wang
errShare
errSave
Copper delocalization leads to ultralow thermal conductivity in chalcohalide CuBiSeCl2
err
err0
PREAI
errHao,Yuzhou; Che,Junwei; Wang,Xiaoying; Li,Xuejie; Lookman,Turab; Sun,Jun; Ding,Xiangdong; Gao,Zhibin
errShare
errSave
Less is more: Sampling chemical space with active learning
err2018-05-22
err571
errOAAI
errSmith, Justin S.; Nebgen, Ben; Lubbers, Nicholas; Isayev, Olexandr; Roitberg, Adrian E.
errShare
errSave
researcher View more