.png){kind=icon}
Return
Transfer Learning Based Multi-Objective Evolutionary Algorithm for Dynamic Workflow Scheduling in the Cloud
.png){kind=icon}
PRE
AI
DOI：10.1109/TCC.2024.3450858.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Managing scientific applications in the Cloud poses many challenges in terms of workflow scheduling, especially in handling multi-objective workflow scheduling under quality of service (QoS) constraints. However, most studies address the workflow scheduling problem on the premise of the unchanged environment, without considering the high dynamics of the Cloud. In this paper, we model the constrained workflow scheduling in a dynamic Cloud environment as a dynamic multi-objective optimization problem with preferences, and propose a transfer learning based multi-objective evolutionary algorithm (TL-MOEA) to tackle the workflow scheduling problem of dynamic nature. Specifically, an elite-led transfer learning strategy is proposed to explore effective parameter adaptation for the MOEA by transferring helpful knowledge from elite solutions in the past environment to accelerate the optimization process. In addition, a multi-space diversity learning strategy is developed to maintain the diversity of the population. To satisfy various QoS constraints of workflow scheduling, a preference-based selection strategy is further designed to enable promising solutions for each iteration. Extensive experiments on five well-known scientific workflows demonstrate that TL-MOEA can achieve highly competitive performance compared to several state-of-art algorithms, and can obtain triple win solutions with optimization objectives of minimizing makespan, cost and energy consumption for dynamic workflow scheduling with user-defined constraints.
Keywords:
Dynamic scheduling
Cloud computing
Processor scheduling
Heuristic algorithms
Quality of service
Costs
Optimization
Dynamic workflow scheduling
multi-objective evolutionary algorithm
transfer learning
quality of service constraints
preference optimization
Journal
I
IF:
5
Papers:
1.9K
Citations:
4.3K
Organization
Cited Papers
ShareSaveUsing Machine Learning Ensemble Methods to Predict Execution Time of e-Science Workflowes in Heterogeneous Distributed Systems.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAIShareSaveShareSave
ShareSaveShareSaveShareSave
View more