arrow
返回

Cost-Efficient Workflow Scheduling Algorithm for Applications With Deadline Constraint on Heterogeneous Clouds

delete2022-09-01
delete43
PRE
AI
X
Xiaoyong Tang
T
Tan Deng *
J
Jing Mei
Y
Yi Liu
程适 封面图
程适 (Shi Cheng)
M
Meng Xia
Z
Zeng Zeng
DOI:10.1109/TPDS.2021.3134247delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, more and more large-scale data processing and computing workflow applications run on heterogeneous clouds. Such cloud applications with precedence-constrained tasks are usually deadline-constrained and their scheduling is an essential problem faced by cloud providers. Moreover, minimizing the workflow execution cost based on cloud billing periods is also a complex and challenging problem for clouds. In realizing this, we first model the workflow applications as I/O Data-aware Directed Acyclic Graph (DDAG), according to clouds with global storage systems. Then, we mathematically state this deadline-constrained workflow scheduling problem with the goal of minimum execution financial cost. We also prove that the time complexity of this problem is NP-hard by deducing from a multidimensional multiple-choice knapsack problem. Third, we propose a heuristic cost-efficient task scheduling strategy called CETSS, which includes workflow DDAG model building, task subdeadline initialization, greedy workflow scheduling algorithm, and task adjusting method. The greedy workflow scheduling algorithm mainly consists of dynamical task renting billing period sharing method and unscheduled task subdeadline relax technique. We perform rigorous simulations on some synthetic randomly generated applications and real-world applications, such as Epigenomics, CyberShake, and LIGO. The experimental results clearly demonstrate that our proposed heuristic CETSS outperforms the existing algorithms and can effective save the total workflow execution cost. In particular, CETSS is very suitable for large workflow applications.
Keyword:
Cloud computing
Task analysis
Costs
Computational modeling
Scheduling
Job shop scheduling
Heuristic algorithms
Workflow application
cost
heterogeneous clouds
schedule length
task scheduling

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

B
Beijing Normal University
学者数:
3.3W
论文数: 2.7W
被引数: 4.2W
H
Hunan Normal University
学者数:
1.3W
论文数: 8.2K
被引数: 9.1K
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Cytoplasmic Male Sterility and Abortive Seed Traits Generated through Mitochondrial Genome Editing Coupled with Allotopic Expression ofatp1in Tobacco
err
IF0
err2023-06-12
err0
errOAAI
errRalph E. Dewey; Devarshi Selote; H. Carol Griffin; Allison N. Dickey; Derek Jantz; J. Jeff Smith; Anna Matthiadis; Josh Strable; Caitlin Kestell; William A. Smith
err分享
err收藏
err分享
err收藏
Scientific workflows for computational reproducibility in the life sciences: Status, challenges and opportunities
err2017-10-01
err91
errOAAI
errCohen-Boulakia, Sarah; Belhajjame, Khalid; Collin, Olivier; Chopard, Jerome; Froidevaux, Christine; Gaignard, Alban; Hinsen, Konrad; Larmande, Pierre; Le Brass, Yvan; Lemoine, Frederic; Mareuil, Fabien; Menager, Herve; Pradal, Christophe; Blanchet, Christophe
err分享
err收藏
Parallel Real-Time Scheduling of DAGs
err2014-12-01
err120
errOAAI
errSaifullah, Abusayeed; Ferry, David; Li, Jing; Agrawal, Kunal; Lu, Chenyang; Gill, Christopher D.
err分享
err收藏
Characterizing and profiling scientific workflows表征和分析科学工作流
err2013-03-01
err626
PREAI
errJuve, Gideon; Chervenak, Ann; Deelman, Ewa; Bharathi, Shishir; Mehta, Gaurang; Vahi, Karan
err分享
err收藏
A Provenance-based Adaptive Scheduling Heuristic for Parallel Scientific Workflows in Clouds
err2012-08-25
err71
PREAI
errde Oliveira, Daniel; Ocana, Kary A. C. S.; Baiao, Fernanda; Mattoso, Marta
err分享
err收藏
学者 查看更多内容