arrow
Return

Multitasking bi-level evolutionary algorithm for data-intensive scientific workflows on clouds

delete2024-03-01
delete7
PRE
AI
蔡
蔡星娟 (Xingjuan Cai)
M
Mengxia Li *
张彦 cover
张彦 (Yan Zhang)
T
Tianhao Zhao
张
张文胜 (Wensheng Zhang)
C
Chen, Jinjun
DOI:10.1016/j.eswa.2023.121833delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the deployment of workflow and other applications, cloud computing is accessible and offers assistance for optimizing workflow execution and enhancing performance. Existing research, however, tends to disregard the influence of dataset migration on workflow execution and focuses more on task execution time. This study suggests a new model for the problem of data-intensive workflow execution. Firstly, according to the structure of the workflow scheduling problem, it is divided into two sub-problems: data placement and task scheduling. The two sub-problems interact with each other and a bi-level optimum model is established. By seeking a better allocation strategy for the dataset placement and then seeking the best task-scheduling solution. Secondly, an improved multitasking bi-level evolutionary algorithm (IM-BLEA) is proposed. When dealing with the lower-level optimization problem (LLOP), offspring are selected by sorting individuals by their performance and overall performance in the population, and this environmental selection enhances the diversity and searchability of the population. Finally, compared with the other multitasking algorithm, IM-BLEA has good performance. Simulation results based on real scientific workflows show that the algorithm improves the values of transfer time and number of selected data centers by 56% and 10% compared to the comparison algorithm.
Keywords:
Evolutionary multitasking algorithms
Bi-level optimization
Data-intensive scientific workflow
Data placement
Task scheduling

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

T
taiyuan university of science & technology
Scholars:
3.5K
Papers: 2.3K
Citations: 3
I
institute of automation, cas
Scholars:
2.2K
Papers: 2.1K
Citations: 2
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Towards workflow scheduling in cloud computing: A comprehensive analysis
err2016-05-01
err186
PREAI
errMasdari, Mohammad; ValiKardan, Sima; Shahi, Zahra; Azar, Sonay Imani
errShare
errSave
Differential evolution algorithm with fitness and diversity ranking-based mutation operator
err2021-03-01
err70
PREAI
errCheng, Jianchao; Pan, Zhibin; Liang, Hao; Gao, Zhaoqi; Gao, Jinghuai
errShare
errSave
Retention of Staff in the Early Childhood Education Workforce
err2009-06-11
err0
PREAI
errSteven J. Holochwost; Kerri DeMott; Martha Buell; Kelly Yannetta; Deborah Amsden
errShare
errSave
Bi-Level Programming Model and Algorithm for VNF Deployment With Data Centers Placement
err2019-01-01
err6
errOAAI
errXuan, Hejun; Wei, Shiwei; Feng, Yan; Liu, Daohua; Li, Yanling
errShare
errSave
Pay Equity: Internal and External Considerations
err1986-12-01
err0
PREAI
errKent Romanoff; Ken Boehm; Edward Benson
errShare
errSave
Self-Regulated Evolutionary Multitask Optimization
err2020-02-01
err133
PREAI
errZheng, Xiaolong; Qin, A. K.; Gong, Maoguo; Zhou, Deyun
errShare
errSave
researcher View more