arrow
Return

Workflow-Based Data Parallel Applications on the EGEE Production Grid Infrastructure

delete2008-09-23
delete9
PRE
AI
J
Johan Montagnat *
T
Tristan Glatard
I
Isabel Campos
F
F. Castejón
X
Xavier Pennec
G
Giuliano Taffoni
V
Vladimir Voznesensky
C
C. Vuerli
DOI:10.1007/s10723-008-9108-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Setting up and deploying complex applications on a Grid infrastructure is still challenging and the programming models are rapidly evolving. Efficiently exploiting Grid parallelism is often not straight forward. In this paper, we report on the techniques used for deploying applications on the EGEE production Grid through four experiments coming from completely different scientific areas: nuclear fusion, astrophysics and medical imaging. These applications have in common the need for manipulating huge amounts of data and all are computationally intensive. All the cases studied show that the deployment of data intensive applications require the development of more or less elaborated application-level workload management systems on top of the gLite middleware to efficiently exploit the EGEE Grid resources. In particular, the adoption of high level workflow management systems eases the integration of large scale applications while exploiting Grid parallelism transparently. Different approaches for scientific workflow management are discussed. The MOTEUR workflow manager strategy to efficiently deal with complex data flows is more particularly detailed. Without requiring specific application development, it leads to very significant speed-ups.
Keywords:
Workflows
Workload management
Data parallelism
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Grid Computing cover
Journal of Grid Computing
IF:
2.9
Papers:
764
Citations:
1.2K

Organization

U
Universidad de Cantabria
Scholars:
6.9K
Papers: 6.1K
Citations: 7.0K
C
centre national de la recherche scientifique (cnrs)
Scholars:
24.5W
Papers: 18.2W
Citations: 279
C
consejo superior de investigaciones cientificas (csic)
Scholars:
8.8W
Papers: 8.5W
Citations: 125
I
Inria
Scholars:
3.5K
Papers: 2.5K
Citations: 343
C
csic - instituto de fisica de cantabria (ifca)
Scholars:
1.3K
Papers: 1.1K
Citations: 5
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
Spatio-temporal expression of Sox genes in murine palatogenesis
err2016-07-01
err0
errOAAI
errMomoko Watanabe; Katsushige Kawasaki; Maiko Kawasaki; Thantrira Portaveetus; Shelly Oommen; James Blackburn; Takahiro Nagai; Atsushi Kitamura; Atsushi Nishikawa; Yasumitsu Kodama; Ritsuo Takagi; Takeyasu Maeda; Paul T. Sharpe; Atsushi Ohazama
errShare
errSave
Improved α-particle confinement in stellarators with poloidally closed contours of the magnetic field strength
err2002-10-09
err27
PREAI
errMikhailov, MI; Shafranov, VD; Subbotin, AA; Isaev, MY; Nührenberg, J; Zille, R; Cooper, WA
errShare
errSave
errShare
errSave
Multiple Origins of the Sodium Channel kdr Mutations in Codling Moth Populations
err2012-08-17
err0
errOAAI
errPierre Franck; Myriam Siegwart; Jerome Olivares; Jean-François Toubon; Claire Lavigne
errShare
errSave
researcher View more