.png){kind=icon}
返回
DolphinNext: a distributed data processing platform for high throughput genomics
.png){kind=icon}
OA
AI
DOI：10.1186/s12864-020-6714-x.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
BackgroundThe emergence of high throughput technologies that produce vast amounts of genomic data, such as next-generation sequencing (NGS) is transforming biological research. The dramatic increase in the volume of data, the variety and continuous change of data processing tools, algorithms and databases make analysis the main bottleneck for scientific discovery. The processing of high throughput datasets typically involves many different computational programs, each of which performs a specific step in a pipeline. Given the wide range of applications and organizational infrastructures, there is a great need for highly parallel, flexible, portable, and reproducible data processing frameworks.Several platforms currently exist for the design and execution of complex pipelines. Unfortunately, current platforms lack the necessary combination of parallelism, portability, flexibility and/or reproducibility that are required by the current research environment. To address these shortcomings, workflow frameworks that provide a platform to develop and share portable pipelines have recently arisen. We complement these new platforms by providing a graphical user interface to create, maintain, and execute complex pipelines. Such a platform will simplify robust and reproducible workflow creation for non-technical users as well as provide a robust platform to maintain pipelines for large organizations.ResultsTo simplify development, maintenance, and execution of complex pipelines we created DolphinNext. DolphinNext facilitates building and deployment of complex pipelines using a modular approach implemented in a graphical interface that relies on the powerful Nextflow workflow framework by providing 1. A drag and drop user interface that visualizes pipelines and allows users to create pipelines without familiarity in underlying programming languages. 2. Modules to execute and monitor pipelines in distributed computing environments such as high-performance clusters and/or cloud 3. Reproducible pipelines with version tracking and stand-alone versions that can be run independently. 4. Modular process design with process revisioning support to increase reusability and pipeline development efficiency. 5. Pipeline sharing with GitHub and automated testing 6. Extensive reports with R-markdown and shiny support for interactive data visualization and analysis.ConclusionDolphinNext is a flexible, intuitive, web-based data processing and analysis platform that enables creating, deploying, sharing, and executing complex Nextflow pipelines with extensive revisioning and interactive reporting to enhance reproducible results.
Keyword:
Pipeline
Workflow
Genome analysis
Big data processing
Sequencing
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.7
论文数:
1.9W
被引数:
5.2W
机构
引用论文
Amazon Elastic Compute Cloud (EC2) versus In-House HPC Platform: A Cost AnalysisAmazon Elastic Compute Cloud (EC2) 与内部HPC平台: 成本分析
PREAI
分享收藏分享收藏Reduced graphene oxide–CdS nanocomposites with enhanced visible-light photoactivity synthesized using ionic-liquid precursors使用离子液体前体合成的具有增强的可见光光活性的还原氧化石墨烯-CdS纳米复合材料.png)
New J. Chem.
New J. Chem.IF0
PREAI
分享收藏分享收藏分享收藏GENCODE: The reference human genome annotation for The ENCODE ProjectGENCODE: ENCODE项目的参考人类基因组注释GENOME RESEARCHOAAI
GENOME RESEARCHIF5.5
OAAI分享收藏
查看更多内容