Return
Streaming I/O for scientific workflow engine acceleration
DOI:10.1016/j.future.2025.107978.png)
Abstract
En 中文
• Integration of memory-based streaming I/O in workflow engines. • Auto-generation of sync rules via DAGonStar dependency analysis. • Faster pipeline task execution via CAPIO system call interception. • Benchmark shows up to 33% execution time reduction with DAGonCAPIO. • Support for local batch and SLURM-based distributed runs.
Keywords:
High-performance computing
Workflow optimization
Scientific workflows
Streaming I/O
In-memory file systems
File-based pipeline acceleration
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
F
IF:
0
Papers:
642
Citations:
0

