.png){kind=icon}
.png){kind=icon}
Return
StreamFlow: Cross-Breeding Cloud With HPC
.png){kind=icon}
OA
AI
DOI：10.1109/TETC.2020.3019202.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Workflows are among the most commonly used tools in a variety of execution environments. Many of them target a specific environment; few of them make it possible to execute an entire workflow in different environments, e.g., Kubernetes and batch clusters. We present a novel approach to workflow execution, called StreamFlow, that complements the workflow graph with the declarative description of potentially complex execution environments, and that makes it possible the execution onto multiple sites not sharing a common data space. StreamFlow is then exemplified on a novel bioinformatics pipeline for single-cell transcriptomic data analysis workflow.
Keywords:
Cloud computing
Task analysis
Containers
Tools
Computer architecture
DSL
Pipelines
Cloud computing
containers
data transfer
high performance computing (HPC)
kubernetes
streamflow
workflows
workflow management system (WMS)
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
5.4
Papers:
1.1K
Citations:
3.4K