arrow
Return

Resource-aware hybrid scheduling algorithm in heterogeneous distributed computing

delete2015-10-01
delete150
PRE
AI
M
Mihaela-Andreea Vasile
F
Florin Pop *
R
Radu-Ioan Tutueanu
V
Valentin Cristea
J
Joanna Kołodziej
DOI:10.1016/j.future.2014.11.019delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Today, almost everyone is connected to the Internet and uses different Cloud solutions to store, deliver and process data. Cloud computing assembles large networks of virtualized services such as hardware and software resources. The new era in which ICT penetrated almost all domains (healthcare, aged-care, social assistance, surveillance, education, etc.) creates the need of new multimedia content-driven applications. These applications generate huge amount of data, require gathering, processing and then aggregation in a fault-tolerant, reliable and secure heterogeneous distributed system created by a mixture of Cloud systems (public/private), mobile devices networks, desktop-based clusters, etc. In this context dynamic resource provisioning for Big Data application scheduling became a challenge in modern systems. We proposed a resource-aware hybrid scheduling algorithm for different types of application: batch jobs and workflows. The proposed algorithm considers hierarchical clustering of the available resources into groups in the allocation phase. Task execution is performed in two phases: in the first, tasks are assigned to groups of resources and in the second phase, a classical scheduling algorithm is used for each group of resources. The proposed algorithm is suitable for Heterogeneous Distributed Computing, especially for modern High-Performance Computing (HPC) systems in which applications are modeled with various requirements (both 10 and computational intensive), with accent on data from multimedia applications. We evaluate their performance in a realistic setting of CloudSim tool with respect to load-balancing, cost savings, dependency assurance for workflows and computational efficiency, and investigate the computing methods of these performance metrics at runtime. (C) 2014 Elsevier B.V. All rights reserved.
Keywords:
Resource provisioning
Task scheduling
Clustering
Heterogeneous distributed computing
Multimedia content-driven applications
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
Papers:
6.8K
Citations:
2.3W

Organization

C
Cracow University of Technology
Scholars:
2.3K
Papers: 2.6K
Citations: 2.6K
Cited Papers

Cited Papers

iCanCloud: A Flexible and Scalable Cloud Infrastructure Simulator
err2012-04-01
err202
PREAI
errNunez, Alberto; Vazquez-Poletti, Jose L.; Caminero, Agustin C.; Castane, Gabriel G.; Carretero, Jesus; Llorente, Ignacio M.
errShare
errSave
errShare
errSave
Virtual Infrastructure Management in Private and Hybrid Clouds
err2009-09-01
err548
PREAI
errSotomayor, Borja; Montero, Ruben S.; Llorente, Ignacio M.; Foster, Ian
errShare
errSave
A novel mutation in CDH11, encoding cadherin‐11, cause Branchioskeletogenital (Elsahy‐Waters) syndrome
err2018-09-08
err0
errOAAI
errMarco Castori; Claus‐Eric Ott; Luigi Bisceglia; Maria Pia Leone; Tommaso Mazza; Stefano Castellana; Jurgen Tomassi; Silvia Lanciotti; Stefan Mundlos; Raoul C. Hennekam; Uwe Kornak; Francesco Brancati
errShare
errSave
errShare
errSave
Synthesis of TiFe Hydrogen Absorbing Alloys Prepared by Mechanical Alloying and SPS Treatment
err2018-04-13
err0
errOAAI
errTohru Nobuki; Taro Moriya; Minoru Hatate; Jean-Claude Crivello; Fermin Cuevas; Jean-Marc Joubert
errShare
errSave
researcher View more