arrow
Return

Taskblaster: A generic framework for automated computational workflows

delete2025-08-02
delete0
delete
OA
AI
A
Ask Hjorth Larsen
M
Mikael Kuisma
T
Tara M. Boland
F
Fredrik Nilsson
K
Kristian S. Thygesen
DOI:10.1039/D5DD00097Adelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We introduce Taskblaster; a generic Python framework for composing; executing; and managing computational workflows with automated error handling. Taskblaster supports dynamic workflows where computational tasks are created in response to the output of other tasks. Flow control with branching and iteration (if and while logic) is provided at the workflow level; making the system Turing complete. A workflow may apply other workflows; which then are referred to as sub-workflows. This promotes a modular structure that increases readability and eases the workflow design and reuse of code. Tasks are associated with file system paths so that they can be intuitively accessed under a directory tree. A command line interface allows monitoring and control of workflows. Tasks are executed by worker processes that may run directly in a terminal or be submitted using a queueing system; allowing task-specific resource control. We provide a library (ASR-lib) of workflows for common materials simulations employing the Atomic Simulation Environment and the GPAW electronic structure code. Taskblaster can equally well be used with other computational codes.
Keywords:
Taskblaster
computational workflows
error handling
dynamic workflows
modular design

Journal

Digital Discovery cover
Digital Discovery
IF:
5.6
Papers:
997
Citations:
1.7K

Organization

No organization information available
Cited Papers

Cited Papers

Identification and design principles of low hole effective mass p-type transparent conducting oxides
err2013-08-13
err569
errOAAI
errHautier, Geoffroy; Miglio, Anna; Ceder, Gerbrand; Rignanese, Gian-Marco; Gonze, Xavier
errShare
errSave
Computational Screening of Layered Materials for Multivalent Ion Batteries
err2019-04-30
err47
errOAAI
errZhang, Zihe; Zhang, Xu; Zhao, Xudong; Yao, Sai; Chen, An; Zhou, Zhen
errShare
errSave
The Computational 2D Materials Database: high-throughput modeling and discovery of atomically thin crystals
err2018-09-07
err0
errOAAI
errSten Haastrup; Mikkel Strange; Mohnish Pandey; Thorsten Deilmann; Per S Schmidt; Nicki F Hinsche; Morten N Gjerding; Daniele Torelli; Peter M Larsen; Anders C Riis-Jensen; Jakob Gath; Karsten W Jacobsen; Jens Jørgen Mortensen; Thomas Olsen; Kristian S Thygesen
errShare
errSave
Materials Design and Discovery with High-Throughput Density Functional Theory: The Open Quantum Materials Database (OQMD)
errJOM
IF2.3
err2013-09-28
err1.9K
PREAI
errSaal, James E.; Kirklin, Scott; Aykol, Muratahan; Meredig, Bryce; Wolverton, C.
errShare
errSave
MISPR: an open-source package for high-throughput multiscale molecular simulations
err2022-09-21
err6
errOAAI
errAtwi, Rasha; Bliss, Matthew; Makeev, Maxim; Rajput, Nav Nidhi
errShare
errSave
Commentary: The Materials Project: A materials genome approach to accelerating materials innovation
err2013-07-18
err9.0K
errOAAI
errJain, Anubhav; Shyue Ping Ong; Hautier, Geoffroy; Chen, Wei; Richards, William Davidson; Dacek, Stephen; Cholia, Shreyas; Gunter, Dan; Skinner, David; Ceder, Gerbrand; Persson, Kristin A.
errShare
errSave
researcher View more