arrow
返回

Adaptive Workflow Scheduling on Cloud Computing Platforms with Iterative Ordinal Optimization

delete2015-04-01
delete43
PRE
AI
F
Fan Zhang *
J
Junwei Cao
K
Kai Hwang
李克勤 封面图
李克勤 (Keqin Li)
S
Samee U. Khan
DOI:10.1109/TCC.2014.2350490delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The scheduling of multitask jobs on clouds is an NP-hard problem. The problem becomes even worse when complex workflows are executed on elastic clouds, such as Amazon EC2 or IBM RC2. The main difficulty lies in the large search space and high overhead of generating optimal schedules, especially for real-time applications with dynamic workloads. In this work, a new iterative ordinal optimization (IOO) method is proposed. The ordinal optimization method is applied in each iteration to achieve sub-optimal schedules. IOO aims at generating more efficient schedules from a global perspective over a long period. We prove through overhead analysis the advantages in time and space efficiency in using the IOO method. The IOO method is designed to adapt to system dynamism to yield suboptimal performance. In cloud experiments on IBM RC2 cloud, we execute 20,000 tasks in LIGO (Laser Interferometer Gravitational-wave Observatory) verification workflow on 128 virtual machines. The IOO schedule is generated in less than 1,000 seconds, while using the Monte Carlo simulation takes 27.6 hours, 100 times longer to yield an optimal schedule. The IOO-optimized schedule results in a throughput of 1,100 tasks/sec with 7 GB memory demand, compared with 60 percent decrease in throughput and 70 percent increase in memory demand in using the Monte Carlo method. Our LIGO experimental results clearly demonstrate the advantage of using the IOO-based workflow scheduling over the traditional blind-pick, ordinal optimization, or Monte Carlo methods. These numerical results are also validated by the theoretical complexity and overhead analysis provided.
Keyword:
Autonomic provisioning
big data
cloud computing
iterative ordinal optimization
workflow scheduling
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE Transactions on Cloud Computing
IF:
5
论文数:
1.8K
被引数:
4.3K

机构

U
university of southern california
学者数:
4.7W
论文数: 3.8W
被引数: 51
T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
S
state university of new york (suny) system
学者数:
6.5W
论文数: 5.8W
被引数: 65
SUNY New Paltz 封面图
SUNY New Paltz
学者数:
169
论文数: 199
被引数: 324
学者 查看更多机构
引用论文

引用论文

Physical properties and phase diagram of the magnetic compound Cr0.26NbS1.74 at high pressures
err2016-07-24
err0
PREAI
errV. A. Sidorov; A. E. Petrova; A. N. Pinyagin; N. N. Kolesnikov; S. S. Khasanov; S. M. Stishov
err分享
err收藏
err2003-01-01
err0
PREAI
errLarry Bencze; Jim Hewitt; Erminia Pedretti; Susan Yoon; Kirk Perris; Roland van Oostveen
err分享
err收藏
Insect pollinators diversity and abundance in Eruca sativa Mill. (Arugula) and Brassica rapa L. (Field mustard) crops
err2019-11-01
err0
errOAAI
errMuhammad Shakeel; Hussain Ali; Sajjad Ahmad; Fazal Said; Khalid Ali Khan; Muhammad Amjad Bashir; Syed Ishtiaq Anjum; Waqar Islam; Hamed A. Ghramh; Mohammad Javed Ansari; Habib Ali
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Security, energy, and performance-aware resource allocation mechanisms for computational grids
err2014-02-01
err40
PREAI
errKolodziej, Joanna; Khan, Samee Ullah; Wang, Lizhe; Kisiel-Dorohinicki, Marek; Madani, Sajjad A.; Niewiadomska-Szynkiewicz, Ewa; Zomaya, Albert Y.; Xu, Cheng-Zhong
err分享
err收藏
学者 查看更多内容