arrow
返回

Cost-Aware Streaming Workflow Allocation on Geo-Distributed Data Centers

delete2016-01-01
delete34
PRE
AI
陈武辉 封面图
陈武辉 (Wuhui Chen) *
I
Incheon Paik
Z
Zhenni Li
DOI:10.1109/TC.2016.2595579delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The virtual machine (VM) allocation problem in cloud computing has been widely studied in recent years, and many algorithms have been proposed in the literature. Most of them have been successfully applied to batch processing models such as MapReduce; however, none of them can be applied to streaming workflow well because of the following weaknesses: 1) failure to capture the characteristics of tasks in streaming workflow for the short life cycle of data streams; 2) most algorithms are based on the assumptions that the price of VMs and traffic among data centers (DCs) are static and fixed. In this paper, we propose a streaming workflow allocation algorithm that takes into consideration the characteristics of streaming work and the price diversity among geo-distributed DCs, to further achieve the goal of cost minimization for streaming big data processing. First, we construct an extended streaming workflow graph (ESWG) based on the task semantics of streaming workflow and the price diversity of geo-distributed DCs, and the streaming workflow allocation problem is formulated into mixed integer linear programming based on the ESWG. Second, we propose two heuristic algorithms to reduce the computational space based on task combination and DC combination in order to meet the strict latency requirement. Finally, our experimental results demonstrate significant performance gains with lower total cost and execution time.
Keyword:
Big data processing
streaming workflow
geo-distributed DCs
streaming workflow allocation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Computers 封面图
IEEE Transactions on Computers
IF:
3.8
论文数:
5.4K
被引数:
9.8K

机构

U
University of Aizu
学者数:
768
论文数: 1.0K
被引数: 302
引用论文

引用论文

A Provenance-based Adaptive Scheduling Heuristic for Parallel Scientific Workflows in Clouds
err2012-08-25
err71
PREAI
errde Oliveira, Daniel; Ocana, Kary A. C. S.; Baiao, Fernanda; Mattoso, Marta
err分享
err收藏
Skin Tightening Technologies
err2014-01-31
err0
errOAAI
errJeremy Green; Ryan Greene
err分享
err收藏
Fundamentals of hot-melt pressure-sensitive adhesive tapes: the effect of tackifier aromaticity
err2007-01-01
err0
PREAI
errEmmett P. O'Brien; Louis T. Germinario; Gary R. Robe; Tim Williams; Doug G. Atkins; Debbie A. Moroney; Mark A. Peters
err分享
err收藏
学者 查看更多内容