.png){kind=icon}
返回
Nextflow in Bioinformatics: Executors Performance Comparison Using Genomics Data
.png){kind=icon}
OA
AI
DOI：10.1016/j.future.2023.01.009.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Processing big data is a computationally demanding task which has usually been fulfilled by HPC batch systems. These complex systems pose a challenge to scientists due to their cumbersome nature and changing environment. The scientists often lack deeper informatics understanding and experiment reproducibility is increasingly becoming a hard request on the research validity.A new computational paradigm - containers - are meant to contain all dependencies and persist the state which help reproducibility. They have gained a lot of popularity in the informatics community but HPC community remains skeptical and doubts that container platforms are appropriate for demanding tasks or that such infrastructure can reach significant performance. In this paper, we observe the performance of various infrastructure types (HPC, Kubernetes, local) on a Sarek Nextflow bioinformatics workflow with real life genomics data of various sizes. We analyze obtained workload trace and discuss pros and cons of utilized infrastructures. We also show some approaches perform better in terms of available resources but others are more suitable for diversified workflows. Based on the results, we provide recommendations for life science groups which plan to analyze data in large scale.(c) 2023 Published by Elsevier B.V.
Keyword:
Kubernetes
HPC
Cloud
Performance comparison
Genomics
Nextflow
Big data
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
F
IF:
6.1
论文数:
6.9K
被引数:
2.3W
机构
引用论文
Reproducible, scalable, and shareable analysis pipelines with bioinformatics workflow managers与生物信息学工作流管理器的可重复、可扩展和可共享的分析管道.png)
NATURE METHODS
NATURE METHODSIF32.1
PREAI
分享收藏Equivalence of variational and slave-boson mean-field treatments of the periodic Anderson model
PREAI
分享收藏The Red Kangaroo pericardium as a material source for the manufacture of percutaneous heart valvesMorphologie
MorphologieIF0
PREAI
分享收藏Electric Heating Behavior of Reduced Oxide Graphene/Carbon Nanotube/Natural Rubber Composites with Macro-Porous Structure and Segregated Filler NetworkPolymersOAAI
PolymersIF0
OAAI分享收藏Nextflow enables reproducible computational workflowsNextflow支持可重复的计算工作流程NATURE BIOTECHNOLOGY
NATURE BIOTECHNOLOGYIF41.7
PREAI
分享收藏
查看更多内容