arrow
Return

freeCycles - Efficient Multi-Cloud Computing Platform

delete2017-10-30
delete2
PRE
AI
R
Rodrigo Bruno *
F
Fernando Albuquerque Costa
P
Paulo Ferreira
DOI:10.1007/s10723-017-9414-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The growing adoption of the MapReduce programming model increases the appeal of using Internet-wide computing platforms to run MapReduce applications on the Internet. However, current data distribution techniques, used in such platforms to distribute the high volumes of information which are needed to run MapReduce jobs, are naive, and therefore fail to offer an efficient approach for running MapReduce over the Internet. Thus, we propose a computing platform called freeCycles that runs MapReduce jobs over the Internet and provides two new main contributions: i) it improves data distribution, and ii) it increases intermediate data availability by replicating tasks or data through nodes in order to avoid losing intermediate data and consequently avoiding significant delays on the overall MapReduce execution time. We present the design and implementation of freeCycles, in which we use the BitTorrent protocol to distribute all data, along with an extensive set of performance results, which confirm the usefulness of the above mentioned contributions. Our system's improved data distribution and availability makes it an ideal platform for large scale MapReduce jobs.
Keywords:
Cloud computing
BitTorrent
BOINC
MapReduce
Volunteer computing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Grid Computing cover
Journal of Grid Computing
IF:
2.9
Papers:
763
Citations:
1.2K

Organization

U
universidade de lisboa
Scholars:
3.4W
Papers: 3.1W
Citations: 29
Cited Papers

Cited Papers

Nuclear forward scattering of synchrotron radiation by deoxymyoglobin
err2000-05-19
err0
PREAI
errC. Keppler; K. Achterhold; A. Ostermann; U. van Bürck; A. I. Chumakov; R. Rüffer; W. Sturhahn; E. E. Alp; F. G. Parak
errShare
errSave
Isotopic composition (C & N) of the suspended particles and N uptake by phytoplankton in a shallow tropical coastal lagoon
err2017-08-01
err0
PREAI
errSivaji Patra; Dipnarayan Ganguly; Manish Tiwari; VishnuVardhan Kanuri; Pradipta R. Muduli; R. S. Robin; K. R. Abhilash; B. Charan Kumar; Siddhesh Satish Nagoji; A. V. Raman; B. R. Subramanian
errShare
errSave
Computing Low Latency Batches with Unreliable Workers in Volunteer Computing Environments
err2009-08-25
err33
errOAAI
errHeien, Eric Martin; Anderson, David P.; Hagihara, Kenichi
errShare
errSave
Water-soluble glycodendrimers: synthesis and stabilization of catalytically active Pd and Pt nanoparticles
err2011-04-01
err0
PREAI
errSylvain Gatard; Liyuan Liang; Lionel Salmon; Jaime Ruiz; Didier Astruc; Sandrine Bouquillon
errShare
errSave
Asymmetric synthesis of N-aryl aziridines
err2002-01-01
err0
PREAI
errJoão Aires-de-Sousa; Sundaresan Prabhakar; Ana M. Lobo; Ana M. Rosa; Mário J.S. Gomes; Marta C. Corvo; David J. Williams; Andrew J.P. White
errShare
errSave
Critical Size for O2 Dissociation by Au Nanoparticles
err2009-01-26
err0
PREAI
errAlberto Roldán; Silvia González; Josep Manel Ricart; Francesc Illas
errShare
errSave
researcher View more