arrow
Return

Knowledge-driven adaptive evolutionary multi-objective scheduling algorithm for cloud workflows

delete2023-10-01
delete5
PRE
AI
H
Hui Zhang *
DOI:10.1016/j.asoc.2023.110655delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Workflow scheduling in cloud platforms is a highly challenging issue because it faces multiple conflicting optimization objectives and large-scale decision variables. Most of the existing multiobjective workflow scheduling algorithms regard the focused problems as black boxes, and optimize large-scale decision variables as a whole. This leads to inefficiency in searching solution spaces that grow exponentially with the increase of decision variables. To compensate the above deficiency, this paper proposes a knowledge-driven adaptive evolutionary multi-objective scheduling algorithm, KAMSA for short, to optimize makespan and cost of workflow execution in cloud platforms. Specifically, we excavate the knowledge that adjustment of a task's execution only affects its successor tasks to divide large-scale decision variables into a series of groups, so as to give play to the strengths of divide-and-conquer technology to improve the evolutionary search efficiency. Moreover, we develop an adaptive resource allocation scheme to reward more evolution opportunities for groups with high contributions to further improve the evolutionary search efficiency. We compare the proposed KAMSA with five state-of-the-art competitors in the context of 20 real-world workflows and the Amazon elastic compute cloud (EC2). The comparison results verify the KAMSA's advantages by prevailing over the five competitors on 18 out of the 20 test cases with respect to the metric hypervolume.& COPY; 2023 Elsevier B.V. All rights reserved.
Keywords:
Cloud computing
Workflow scheduling
Large-scale optimization
Evolutionary computation
Multi -objective optimization

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

Y
Yancheng Teachers University
Scholars:
1.5K
Papers: 1.1K
Citations: 1.5K
N
northeast normal university - china
Scholars:
1.2W
Papers: 9.2K
Citations: 23
Cited Papers

Cited Papers

Palladium in plant ash
err1979-12-01
err0
PREAI
errE. L. Kothny
errShare
errSave
errShare
errSave
Lipid metabolism in dopaminergic neurons influences light entrainment
err2023-03-09
err0
errOAAI
errRegina F. Fernandez; Emily S. Wilson; Victoria Diaz; Jonatan Martínez‐Gardeazabal; Rachel Foguth; Jason R. Cannon; Shelley N. Jackson; Brian P. Hermann; Jeffrey B. Eells; Jessica M. Ellis
errShare
errSave
Performance assessment of multiobjective optimizers: An analysis and review
err2003-04-01
err3.1K
errOAAI
errZitzler, E; Thiele, L; Laumanns, M; Fonseca, CM; da Fonseca, VG
errShare
errSave
errShare
errSave
Continuous authentication on relational streams
err2009-06-06
err0
errOAAI
errStavros Papadopoulos; Yin Yang; Dimitris Papadias
errShare
errSave
errShare
errSave
researcher View more