arrow
Return

CloudRank-D: benchmarking and ranking cloud computing systems for data processing applications

delete2012-08-03
delete60
PRE
AI
C
Chunjie Luo
J
Jianfeng Zhan *
Z
Zhen Jia
L
Lei Wang
G
Gang Lü
L
Lixin Zhang
C
Chengzhong Xu
N
Ninghui Sun
DOI:10.1007/s11704-012-2118-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the explosive growth of information, more and more organizations are deploying private cloud systems or renting public cloud systems to process big data. However, there is no existing benchmark suite for evaluating cloud performance on the whole system level. To the best of our knowledge, this paper proposes the first benchmark suite CloudRank-D to benchmark and rank cloud computing systems that are shared for running big data applications. We analyze the limitations of previous metrics, e.g., floating point operations, for evaluating a cloud computing system, and propose two simple metrics: data processed per second and data processed per Joule as two complementary metrics for evaluating cloud computing systems. We detail the design of CloudRank-D that considers representative applications, diversity of data characteristics, and dynamic behaviors of both applications and system software platforms. Through experiments, we demonstrate the advantages of our proposed metrics. In several case studies, we evaluate two small-scale deployments of cloud computing systems using CloudRank-D.
Keywords:
data center systems
clouds
big data applications
benchmarks
evaluation metrics

Journal

Frontiers of Computer Science cover
Frontiers of Computer Science
IF:
4.6
Papers:
1.6K
Citations:
2.8K

Organization

I
institute of computing technology, cas
Scholars:
1.0K
Papers: 878
Citations: 1
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Broadband Rectenna Arrays for Randomly Polarized Incident Waves
err2000-10-01
err0
PREAI
errJoseph A. Hagerty; Nestor D. Lopez; Branko Popovic; Zoya Popovic
errShare
errSave
errShare
errSave
WirePrint
err2014-10-05
err0
PREAI
errStefanie Mueller; Sangha Im; Serafima Gurevich; Alexander Teibrich; Lisa Pfisterer; François Guimbretière; Patrick Baudisch
errShare
errSave
Active and passive surveillance of yellow fever vaccine 17D or 17DD-associated serious adverse events: Systematic review
err2011-06-01
err0
PREAI
errRoger E. Thomas; Diane L. Lorenzetti; Wendy Spragins; Dave Jackson; Tyler Williamson
errShare
errSave
Neuroanatomy of the calf brain as revealed by high‐resolution magnetic resonance imaging
err2009-01-02
err0
PREAI
errMartin J. Schmidt; Ulrich Pilatus; Antje Wigger; Martin Kramer; Helmut A. Oelschläger
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more