返回
freeCycles - Efficient Multi-Cloud Computing Platform
DOI:10.1007/s10723-017-9414-2.png)
摘要
En 中文
The growing adoption of the MapReduce programming model increases the appeal of using Internet-wide computing platforms to run MapReduce applications on the Internet. However, current data distribution techniques, used in such platforms to distribute the high volumes of information which are needed to run MapReduce jobs, are naive, and therefore fail to offer an efficient approach for running MapReduce over the Internet. Thus, we propose a computing platform called freeCycles that runs MapReduce jobs over the Internet and provides two new main contributions: i) it improves data distribution, and ii) it increases intermediate data availability by replicating tasks or data through nodes in order to avoid losing intermediate data and consequently avoiding significant delays on the overall MapReduce execution time. We present the design and implementation of freeCycles, in which we use the BitTorrent protocol to distribute all data, along with an extensive set of performance results, which confirm the usefulness of the above mentioned contributions. Our system's improved data distribution and availability makes it an ideal platform for large scale MapReduce jobs.
Keyword:
Cloud computing
BitTorrent
BOINC
MapReduce
Volunteer computing
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2.9
论文数:
763
被引数:
1.2K
机构
引用论文
Computing Low Latency Batches with Unreliable Workers in Volunteer Computing Environments在志愿计算环境中使用不可靠的工作人员计算低延迟批次
Characterization of Four Covalently-Linked Yeast Cytochrome c/Cytochrome c Peroxidase Complexes: Evidence for Electrostatic Interaction between Bound Cytochrome c Molecules
Biochemistry
IF0

