arrow
Return

Towards decomposition based multi-objective workflow scheduling for big data processing in clouds

delete2020-11-24
delete13
PRE
AI
E
Emmanuel Bugingo
D
Defu Zhang
Z
Zhaobin Chen
W
Wei Zheng *
DOI:10.1007/s10586-020-03208-wdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A workflow is a group of tasks that are processed in a particular order to complete an application. Also, it is a popular paradigm used to model complex big-data applications. Executing complex applications in a distributed system such as cloud or cluster implicates optimization of several conflicting objectives such as monetary cost, energy consumption, total execution time of the application (makespan). Regardless of this trend, most of the workflow scheduling approaches focused on single or bi-objective optimization problem. In this paper, we considered the problem of scheduling workflows in a cloud environment as a multi-objective optimization problem, and hence proposed a multi-objective workflow-scheduling algorithm based on decomposition. The proposed algorithm is capable of finding optimal solutions with a single run. Our evaluation results show that, by a single run, the proposed approach manages to obtain the Pareto Front solutions which are at least as good as schedules produced by running a single-objective scheduling algorithm with constraints for multiple times.
Keywords:
Multi-objective optimization
Workflow scheduling
Cloud computing
Decomposition approach
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
Papers:
5.0K
Citations:
7.5K

Organization

X
xiamen university
Scholars:
5.9W
Papers: 3.8W
Citations: 67
Cited Papers

Cited Papers

Characterizing and profiling scientific workflows
err2013-03-01
err626
PREAI
errJuve, Gideon; Chervenak, Ann; Deelman, Ewa; Bharathi, Shishir; Mehta, Gaurang; Vahi, Karan
errShare
errSave
errShare
errSave
Multi-objective scheduling for scientific workflow in multicloud environment
err2018-07-01
err82
errOAAI
errHu, Haiyang; Li, Zhongjin; Hu, Hua; Chen, Jie; Ge, Jidong; Li, Chuanyi; Chang, Victor
errShare
errSave
researcher View more