arrow
返回

Transfer Learning Based Multi-Objective Evolutionary Algorithm for Dynamic Workflow Scheduling in the Cloud

delete2024-10-01
delete2
PRE
AI
H
Huamao Xie
丁
丁丁 (Ding Ding) *
L
Lihong Zhao
K
Kaixuan Kang
DOI:10.1109/TCC.2024.3450858delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Managing scientific applications in the Cloud poses many challenges in terms of workflow scheduling, especially in handling multi-objective workflow scheduling under quality of service (QoS) constraints. However, most studies address the workflow scheduling problem on the premise of the unchanged environment, without considering the high dynamics of the Cloud. In this paper, we model the constrained workflow scheduling in a dynamic Cloud environment as a dynamic multi-objective optimization problem with preferences, and propose a transfer learning based multi-objective evolutionary algorithm (TL-MOEA) to tackle the workflow scheduling problem of dynamic nature. Specifically, an elite-led transfer learning strategy is proposed to explore effective parameter adaptation for the MOEA by transferring helpful knowledge from elite solutions in the past environment to accelerate the optimization process. In addition, a multi-space diversity learning strategy is developed to maintain the diversity of the population. To satisfy various QoS constraints of workflow scheduling, a preference-based selection strategy is further designed to enable promising solutions for each iteration. Extensive experiments on five well-known scientific workflows demonstrate that TL-MOEA can achieve highly competitive performance compared to several state-of-art algorithms, and can obtain triple win solutions with optimization objectives of minimizing makespan, cost and energy consumption for dynamic workflow scheduling with user-defined constraints.
Keyword:
Dynamic scheduling
Cloud computing
Processor scheduling
Heuristic algorithms
Quality of service
Costs
Optimization
Dynamic workflow scheduling
multi-objective evolutionary algorithm
transfer learning
quality of service constraints
preference optimization

期刊

I
IEEE Transactions on Cloud Computing
IF:
5
论文数:
1.9K
被引数:
4.3K

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
引用论文

引用论文

Using Machine Learning Ensemble Methods to Predict Execution Time of e-Science Workflowes in Heterogeneous Distributed Systems
err2019-01-01
err20
errOAAI
errNadeem, Farrukh; Alghazzawi, Daniyal; Mashat, Abdulfattah; Faqeeh, Khalid; Almalaise, Abdullah
err分享
err收藏
Wide field-of-view volumetric imaging by a mesoscopic scanning oblique plane microscopy with switchable objective lenses
err2020-03-01
err0
errOAAI
errWenjun Shao; Kivilcim Kilic; Wenqing Yin; Gregory Wirak; Xiaodan Qin; Hui Feng; David Boas; Christopher V. Gabel; Ji Yi
err分享
err收藏
err分享
err收藏
Characterizing and profiling scientific workflows表征和分析科学工作流
err2013-03-01
err626
PREAI
errJuve, Gideon; Chervenak, Ann; Deelman, Ewa; Bharathi, Shishir; Mehta, Gaurang; Vahi, Karan
err分享
err收藏
A Tutorial on Implantable Hearing Amplification Options for Adults with Unilateral Microtia and Atresia
err2014-01-01
err0
errOAAI
errJoannie Ka Yin Yu; Lena Lai Nar Wong; Willis Sung Shan Tsang; Michael Chi Fai Tong
err分享
err收藏
学者 查看更多内容