arrow
Return

On cluster resource allocation for multiple parallel task graphs

delete2010-12-01
delete19
delete
OA
AI
H
Henri Casanova
F
Frédéric Desprez
F
Frédéric Suter *
DOI:10.1016/j.jpdc.2010.08.017delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Many scientific applications can be structured as parallel task graphs (PTGs) that is graphs of data-parallel tasks Adding data parallelism to a task-parallel application provides opportunities for higher performance and scaliability but poses additional scheduling challenges In this paper we study the off-line scheduling of multiple PTGs on a single homogeneous cluster The objective is to optimize performance without compromising fairness among the PTGs We consider the range of previously proposed scheduling algorithms applicable to this problem from both the applied and the theoretical literature and we propose minor improvements when possible Our main contribution is an extensive evaluation of these algorithms in simulation using both synthetic and real-world application configurations using two different metrics for performance and one metric for fairness We identify a handful of algorithms that provide good trade-offs when considering all these metrics The best algorithm overall is one that structures the schedule as a sequence of phases of increasing duration based on a makespan guarantee produced by an approximation algorithm (C) 2010 Elsevier Inc All rights reserved
Keywords:
Multi criteria scheduling
Resource allocation
Parallel task graphs
Cluster
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Parallel and Distributed Computing cover
Journal of Parallel and Distributed Computing
IF:
4
Papers:
3.8K
Citations:
4.8K

Organization

C
centre national de la recherche scientifique (cnrs)
Scholars:
24.5W
Papers: 18.2W
Citations: 279