arrow
Return

A Dataflow-Based Scientific Workflow Composition Framework

delete2012-01-01
delete23
PRE
AI
X
Xubo Fei *
S
Shiyong Lu
DOI:10.1109/TSC.2010.58delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Scientific workflow has recently become an enabling technology to automate and speed up the scientific discovery process. Although several scientific workflow management systems (SWFMSs) have been developed, a formal scientific workflow composition model in which workflow constructs are fully compositional one with another is still missing. In this paper, we propose a dataflow-based scientific workflow composition framework consisting of 1) a dataflow-based scientific workflow model that separates the declaration of the workflow interface from the definition of its functional body; 2) a set of workflow constructs, including Map, Reduce, Tree, Loop, Conditional, and Curry, which are fully compositional one with another; 3) a dataflow-based exception handling approach to support hierarchical exception propagation and user-defined exception handling. Our workflow composition framework is unique in that workflows are the only operands for composition; in this way, our approach elegantly solves the two-world problem in existing composition frameworks, in which composition needs to deal with both the world of tasks and the world of workflows. The proposed framework is implemented and several case studies are conducted to validate our techniques.
Keywords:
Scientific workflow
scientific workflow model
workflow composition
MapReduce
VIEW
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Services Computing cover
IEEE Transactions on Services Computing
IF:
5.8
Papers:
2.1K
Citations:
6.5K

Organization

W
wayne state university
Scholars:
2.0W
Papers: 1.6W
Citations: 17
Cited Papers

Cited Papers

Organic carbon stock changes and crop yield in a tropical sandy soil under rainfed grains-cotton farming systems in Bahia, Brazil
err2022-01-01
err0
errOAAI
errAlexandre Cunha de Barcellos Ferreira; Julio Cesar Bogiani; Valdinei Sofatti; Ana Luiza Dias Coelho Borin; Fabiano José Perina; Gilvan Barbosa Ferreira; Mellissa Ananias Soler da Silva; Pedro Luiz Oliveira de Almeida Machado
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Indicadores para cidades inteligentes: a emergência de um novo clichê
err2019-08-23
err0
errOAAI
errSonia Maria Viggiani Coutinho; Maria Da Penha Vasconcellos; Carolina Cássia Conceição Abílio; Clóvis Armando Alvarenga Neto
errShare
errSave
Loss of Prion Protein in a Transgenic Model of Amyotrophic Lateral Sclerosis
err2002-02-01
err0
PREAI
errLuc Dupuis; Corinne Mbebi; José-Luis Gonzalez de Aguilar; Frédérique Rene; André Muller; Marc de Tapia; Jean-Philippe Loeffler
errShare
errSave
The value of prehospital echocardiography in shock management
err2013-02-01
err0
PREAI
errPierre-Marie Brun; Hichem Chenaitia; Jonathan Gonzva; Jacques Bessereau; Xavier Bobbia; Michael Peyrol
errShare
errSave
Visualising the crossover between 3D and 2D topological defects in nematic liquid crystals
err2018-07-10
err0
PREAI
errSajedeh Afghah; Robin L. B. Selinger; Jonathan V. Selinger
errShare
errSave
researcher View more