arrow
返回

Scheduling Constrained Cloud Workflow Tasks via Evolutionary Multitasking Optimization With Adaptive Knowledge Transfer

delete2024-11-01
delete0
PRE
AI
周
周佳军 (Jiajun Zhou)
Gao Liang 封面图
Gao Liang (Liang Gao) *
Y
Yun Li
DOI:10.1109/TSC.2024.3463423delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Cloud workflow scheduling (CWS) is critical for meeting user's high performance expectations in large-scale data processing and computing applications. CWS is known to be NP-hard and needs advanced scheduling techniques. Evolutionary algorithm and heuristic-based search techniques have gained massive popularity in addressing CWS, yet they either suffer from expensive computational cost or heavily rely on domain-specific experiences, which limit their practical applications. Bearing this in mind, we develop a novel evolutionary multi-task optimization framework to tackle a group of constrained CWS tasks simultaneously with the aid of adaptive cross-task problem-solving knowledge transfer. In particular, two collaborative knowledge exchange strategies, namely, constraint-free archive strategy and cross-task evolution strategy, are devised to extract useful building blocks from foreign tasks to boost the search efficiency. Further, to leverage the cooperative effects of both strategies, we develop an adaptive switching mechanism such that appropriate knowledge transfer strategies are learned automatically according to the population evolution status. Extensive experiments are conducted on real-world applications under various conditions, the comparison results show that our proposal delivers higher quality schedules than the state-of-the-art competitors in most cases.
Keyword:
Processor scheduling
Search problems
Problem-solving
Optimal scheduling
Heuristic algorithms
Genetic algorithms
Costs
Cloud computing
workflow scheduling
knowledge transfer
multi-task optimization
multiple workflows

期刊

IEEE Transactions on Services Computing 封面图
IEEE Transactions on Services Computing
IF:
5.8
论文数:
2.1K
被引数:
6.5K

机构

C
China University of Geosciences
学者数:
3.7W
论文数: 2.8W
被引数: 4.3W
S
shenzhen institute for advanced study, uestc
学者数:
419
论文数: 371
被引数: 1
引用论文

引用论文

Cloud Computing Resource Scheduling and a Survey of Its Evolutionary Approaches
err2015-07-21
err352
errOAAI
errZhan, Zhi-Hui; Liu, Xiao-Fang; Gong, Yue-Jiao; Zhang, Jun; Chung, Henry Shu-Hung; Li, Yun
err分享
err收藏
ET2FA: A Hybrid Heuristic Algorithm for Deadline-Constrained Workflow Scheduling in Cloud
err2022-01-01
err22
PREAI
errSun, Zaixing; Zhang, Boyu; Gu, Chonglin; Xie, Ruitao; Qian, Bin; Huang, Hejiao
err分享
err收藏
err分享
err收藏
Characterizing and profiling scientific workflows表征和分析科学工作流
err2013-03-01
err626
PREAI
errJuve, Gideon; Chervenak, Ann; Deelman, Ewa; Bharathi, Shishir; Mehta, Gaurang; Vahi, Karan
err分享
err收藏
Dynamic Auxiliary Task-Based Evolutionary Multitasking for Constrained Multiobjective Optimization
err2023-06-01
err61
PREAI
errQiao, Kangjia; Yu, Kunjie; Qu, Boyang; Liang, Jing; Song, Hui; Yue, Caitong; Lin, Hongyu; Tan, Kay Chen
err分享
err收藏
Multiobjective Cloud Workflow Scheduling: A Multiple Populations Ant Colony System Approach
err2019-08-01
err204
errOAAI
errChen, Zong-Gan; Zhan, Zhi-Hui; Lin, Ying; Gong, Yue-Jiao; Gu, Tian-Long; Zhao, Feng; Yuan, Hua-Qiang; Chen, Xiaofeng; Li, Qing; Zhang, Jun
err分享
err收藏
学者 查看更多内容