Streaming I/O for scientific workflow engine acceleration

Simone Perrotta

doi:10.1016/j.future.2025.107978

2025-07-22

Simone Perrotta

Ciro Giuseppe De Vita *

Gennaro Mellone

Marco Edoardo Santimaria

Massimo Torquati

Javier Garcia‐Blas

Raffaele Montella

DOI：10.1016/j.future.2025.107978

原文链接

查看原文

摘要

En 中文

• 基于内存的流式I/O在流程引擎中的集成。 • 基于DAGonStar依赖分析的同步规则自动生成。 • 通过CAPIO系统调用拦截加速流水线任务执行。 • 基准测试显示DAGonCAPIO可将执行时间最多减少33%。 • 支持本地批处理和基于SLURM的分布式运行。

Keyword:

High-performance computing

Workflow optimization

Scientific workflows

Streaming I/O

In-memory file systems

File-based pipeline acceleration

AI总结

对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Future Generation Computer Systems

IF:

论文数:

642

被引数:

机构

University of Turin

学者数:

3.7W

论文数: 2.8W

被引数: 3.2W

University of Pisa

学者数:

3.1W

论文数: 2.4W

被引数: 2.4W

引用论文

StreamFlow: Cross-Breeding Cloud With HPC

IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING

IF5.4

2021-10-01

OAAI

Colonnelli, Iacopo; Cantalupo, Barbara; Merelli, Ivan; Aldinucci, Marco

Using simple PID-inspired controllers for online resilient resource management of distributed scientific workflows

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE

IF6.1

2019-06-01

OAAI

da Silva, Rafael Ferreira; Filgueira, Rosa; Deelman, Ewa; Pairo-Castineira, Erola; Overton, Ian M.; Atkinson, Malcolm P.

PyCOMPSs: Parallel computational workflows in Python PyCOMPSs: Python中的并行计算工作流

INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS

IF2.5

2016-07-27

OAAI

Tejedor, Enric; Becerra, Yolanda; Alomar, Guillem; Queralt, Anna; Badia, Rosa M.; Torres, Jordi; Cortes, Toni; Labarta, Jesus

Knowledge for a Longer Life: Development Impetus for Energy-efficient Smartphone Applications

2015 IEEE THIRD INTERNATIONAL CONFERENCE ON MOBILE SERVICES MS 2015

IF0

2015-03-01

PREAI

Hans, Ronny; Burgstahler, Daniel; Mueller, Alexander; Zahn, Manuel; Stingl, Dominik

Workflows' applications in computational environmental science: a survey

Proceedings of the 2nd Workshop on Workflows in Distributed Environments

IF0

2024-04-22

PREAI

Mellone,Gennaro; De Vita,Ciro Giuseppe; Caramiello,Dario; Singh,David Exposito; Blas,Javier Garcia; Ciaramella,Angelo

Four-Dimensional Variational Data Assimilation for WRF: Formulation and Preliminary Results

Monthly Weather Review

IF0

2009-01-01

OAAI

Xiang-Yu Huang; Qingnong Xiao; Dale M. Barker; Xin Zhang; John Michalakes; Wei Huang; Tom Henderson; John Bray; Yongsheng Chen; Zaizhong Ma; Jimy Dudhia; Yongrun Guo; Xiaoyan Zhang; Duk-Jin Won; Hui-Chuan Lin; Ying-Hwa Kuo

Nextflow enables reproducible computational workflows Nextflow支持可重复的计算工作流程

NATURE BIOTECHNOLOGY

IF41.7

2017-04-11

1.2K

PREAI

Di Tommaso, Paolo; Chatzou, Maria; Floden, Evan W.; Prieto Barja, Pablo; Palumbo, Emilio; Notredame, Cedric

WRF-based scenario experiment research on urban heat island: A review 基于WRF的城市热岛情景实验研究综述

URBAN CLIMATE

IF6.9

2023-05-01

PREAI

Zhu, Dun; Ooka, Ryozo

Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences

GENOME BIOLOGY

IF9.4

2010-08-25

3.0K

OAAI

Goecks, Jeremy; Nekrutenko, Anton; Taylor, James

THE WEATHER RESEARCH AND FORECASTING MODEL Overview, System Efforts, and Future Directions

BULLETIN OF THE AMERICAN METEOROLOGICAL SOCIETY

IF5.9

2017-09-06

819

OAAI

Powers, Jordan G.; Klemp, Joseph B.; Skamarock, William C.; Davis, Christopher A.; Dudhia, Jimy; Gill, David O.; Coen, Janice L.; Gochis, David J.; Ahmadov, Ravan; Peckham, Steven E.; Grell, Georg A.; Michalakes, John; Trahan, Samuel; Benjamin, Stanley G.; Alexander, Curtis R.; Dimego, Geoffrey J.; Wang, Wei; Schwartz, Craig S.; Romine, Glen S.; Liu, Zhiquan; Snyder, Chris; Chen, Fei; Barlage, Michael J.; Yu, Wei; Duda, Michael G.

查看更多内容