arrow
Return

Dynamic variable analysis guided adaptive evolutionary multi-objective scheduling for large-scale workflows in cloud computing

delete2024-10-01
delete2
PRE
AI
Y
Yangkun Xia
X
Xinran Luo
W
Wei Yang
T
Ting Jin
L
Li Jun *
L
Lining Xing
L
Lijun Pan
DOI:10.1016/j.swevo.2024.101654delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Energy consumption and makespan of workflow execution are two core performance indicators in operating cloud platforms. But, simultaneously optimizing these two indicators encounters various challenges, such as elastic resources, large-scale decision variables, and sophisticated workflow structures. To handle these challenges, we design an adaptive evolutionary scheduling algorithm, namely AESA, with three innovative strategies. First, a heuristic population initialization strategy is devised to gather workflow tasks onto limited potential resources, thereby alleviating the negative impact of redundant cloud resources on evolutionary search efficiency. Then, a variable analysis strategy is designed to dynamically measure the contribution each decision variable in pushing the population towards Pareto-optimal fronts. Moreover, AESA embraces an adaptive strategy to reward more evolutionary opportunities for decision variables with higher contributions to handle large-scale decision variables in a targeted manner, further improving the efficiency of evolutionary search. Finally, extensive experiments are performed based on real-world cloud platforms and workflow traces to verify the effectiveness of the proposed AESA. The comparison results validate its superior performance by significantly outperforming five representative baselines in optimizing makespan and energy consumption. Also, the results of ablation experiments demonstrate that all three components contribute to AESA's overall performance, with the adaptive reward mechanism being the most significant.
Keywords:
Green computing
Cloud workflow
Large-scale scheduling
Evolutionary algorithm
Multi-objective optimization

Journal

Swarm and Evolutionary Computation cover
Swarm and Evolutionary Computation
IF:
8.5
Papers:
2.2K
Citations:
1.0W

Organization

H
hunan institute of engineering
Scholars:
1.5K
Papers: 1.2K
Citations: 0
M
ministry of education - china
Scholars:
2.5W
Papers: 1.0W
Citations: 13
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Scaling Up Dynamic Optimization Problems: A Divide-and-Conquer Approach
err2020-02-01
err46
errOAAI
errYazdani, Danial; Omidvar, Mohammad Nabi; Branke, Juergen; Trung Thanh Nguyen; Yao, Xin
errShare
errSave
Data Center Energy Consumption Modeling: A Survey
err2016-01-01
err683
errOAAI
errDayarathna, Miyuru; Wen, Yonggang; Fan, Rui
errShare
errSave
errShare
errSave
A modified reverse-based analysis logic mining model with Weighted Random 2 Satisfiability logic in Discrete Hopfield Neural Network and multi-objective training of Modified Niched Genetic Algorithm
err2024-04-01
err38
PREAI
errZamri, Nur Ezlin; Mansor, Mohd. Asyraf; Kasihmuddin, Mohd Shareduwan Mohd; Sidik, Siti Syatirah; Alway, Alyaa; Romli, Nurul Atiqah; Guo, Yueling; Jamaludin, Siti Zulaikha Mohd
errShare
errSave
Heterogeneous differential evolution particle swarm optimization with local search
err2023-05-11
err8
errOAAI
errLin, Anping; Liu, Dong; Li, Zhongqi; Hasanien, Hany M.; Shi, Yaoting
errShare
errSave
Cost and makespan scheduling of workflows in clouds using list multiobjective optimization technique
err2021-01-01
err39
PREAI
errHan, Pengcheng; Du, Chenglie; Chen, Jinchao; Ling, Fuyuan; Du, Xiaoyan
errShare
errSave
researcher View more