arrow
Return

Streamlining data-intensive biology with workflow systems

delete2021-01-13
delete31
delete
OA
AI
T
Taylor Reiter
P
Phillip Brooks
L
Luiz Irber
S
Shannon E K Joslin
C
Charles Reid
C
Camille Scott
C
C. Titus Brown
N
N. Tessa Pierce‐Ward *
DOI:10.1093/gigascience/giaa140delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
As the scale of biological data generation has increased, the bottleneck of research has shifted from data generation to analysis. Researchers commonly need to build computational workflows that include multiple analytic tools and require incremental development as experimental insights demand tool and parameter modifications. These workflows can produce hundreds to thousands of intermediate files and results that must be integrated for biological insight. Data-centric workflow systems that internally manage computational resources, software, and conditional execution of analysis steps are reshaping the landscape of biological data analysis and empowering researchers to conduct reproducible analyses at scale. Adoption of these tools can facilitate and expedite robust data analysis, but knowledge of these techniques is still lacking. Here, we provide a series of strategies for leveraging workflow systems with structured project, data, and resource management to streamline large-scale biological analysis. We present these practices in the context of high-throughput sequencing data analysis, but the principles are broadly applicable to biologists working beyond this field.
Keywords:
workflows
automation
repeatability
data-intensive biology
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

GigaScience cover
GigaScience
IF:
3.9
Papers:
1.6K
Citations:
1.2W

Organization

U
university of california davis
Scholars:
3.4W
Papers: 2.6W
Citations: 45
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K