.png){kind=icon}
返回
Transformation-Based Streaming Workflow Allocation on Geo-Distributed Datacenters for Streaming Big Data Processing
.png){kind=icon}
PRE
AI
DOI：10.1109/TSC.2016.2614297.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The cost-minimization problem for streaming workflow (SW) has already become increasingly important and even critical in stream big data processing, particularly for geographically distributed datacenters, because of its huge demand on computing and communicating resources. Existing virtual machine (VM) allocation algorithms in cloud computing have been widely applied to batch-processing models; however, none of them can be successfully applied to SW because: 1) they failed to adapt the continuous execution characteristic of SW; and 2) most of them are all based on the assumption that the price of traffic and VMs among datacenters are uniform. In this paper, we propose a transformation-based SW allocation algorithm with the goal of cost-minimization for stream big data processing in geographically distributed datacenters, considering the characteristics of SW and price heterogeneity among geographically distributed datacenters. We first propose a cost-aware workflow transformation framework based on eight well-designed and verified transformation rules for cost reduction to adapt the continuous execution characteristic of SW. We then formulate the joint VM-traffic optimization problem and show that it is NP-hard. To produce the optimal solution in polynomial time, we then transform the SW allocation problem into the minimum-cost maximum-flow problem, considering both traffic and VMs price heterogeneity. Finally, our experimental results validate the high cost efficiency of our approach with lower computing and communicating costs by optimizing the workflow specification and joint VM-traffic cost optimization.
Keyword:
Big data processing
stream data
workflow transformation
geo-distributed datacenters
workflow allocation
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
5.8
论文数:
2.1K
被引数:
6.5K
机构
引用论文
A REFRESHED ORTHODOX VIEW OF PALEOBIOGEOGRAPHY OF SOUTH AMERICAN MAMMALS南美哺乳动物古生物地理学的正统新视角.png)
Evolution
EvolutionIF0
PREAI
分享收藏分享收藏Spartina alterniflora invasion increases soil inorganic nitrogen pools through interactions with tidal subsidies in the Yangtze Estuary, ChinaOecologia
OecologiaIF0
PREAI
分享收藏Full Valence Band Photoemission from Liquid Water Using EUV Synchrotron Radiation使用EUV同步加速器辐射从液态水中全价带光发射
PREAI
分享收藏
查看更多内容