arrow
Return

Multitasking bi-level evolutionary algorithm for data-intensive scientific workflows on clouds

delete2024-03-01
delete7
PRE
AI
蔡星娟 (Xingjuan Cai)
M
Mengxia Li *
张彦 cover
张彦 (Yan Zhang)
T
Tianhao Zhao
张文胜 (Wensheng Zhang)
C
Chen, Jinjun
DOI:10.1016/j.eswa.2023.121833delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the deployment of workflow and other applications, cloud computing is accessible and offers assistance for optimizing workflow execution and enhancing performance. Existing research, however, tends to disregard the influence of dataset migration on workflow execution and focuses more on task execution time. This study suggests a new model for the problem of data-intensive workflow execution. Firstly, according to the structure of the workflow scheduling problem, it is divided into two sub-problems: data placement and task scheduling. The two sub-problems interact with each other and a bi-level optimum model is established. By seeking a better allocation strategy for the dataset placement and then seeking the best task-scheduling solution. Secondly, an improved multitasking bi-level evolutionary algorithm (IM-BLEA) is proposed. When dealing with the lower-level optimization problem (LLOP), offspring are selected by sorting individuals by their performance and overall performance in the population, and this environmental selection enhances the diversity and searchability of the population. Finally, compared with the other multitasking algorithm, IM-BLEA has good performance. Simulation results based on real scientific workflows show that the algorithm improves the values of transfer time and number of selected data centers by 56% and 10% compared to the comparison algorithm.
Keywords:
Evolutionary multitasking algorithms
Bi-level optimization
Data-intensive scientific workflow
Data placement
Task scheduling

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

T
taiyuan university of science & technology
Scholars:
3.5K
Papers: 2.3K
Citations: 3
I
institute of automation, cas
Scholars:
2.2K
Papers: 2.1K
Citations: 2
C
chinese academy of sciences
Scholars:
56.0W
Papers: 44.7W
Citations: 704
researcher View more organizations