arrow
Return

CloudRank-D: benchmarking and ranking cloud computing systems for data processing applications

delete2012-08-03
delete60
PRE
AI
C
Chunjie Luo
J
Jianfeng Zhan *
Z
Zhen Jia
L
Lei Wang
G
Gang Lü
L
Lixin Zhang
C
Chengzhong Xu
N
Ninghui Sun
DOI:10.1007/s11704-012-2118-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the explosive growth of information, more and more organizations are deploying private cloud systems or renting public cloud systems to process big data. However, there is no existing benchmark suite for evaluating cloud performance on the whole system level. To the best of our knowledge, this paper proposes the first benchmark suite CloudRank-D to benchmark and rank cloud computing systems that are shared for running big data applications. We analyze the limitations of previous metrics, e.g., floating point operations, for evaluating a cloud computing system, and propose two simple metrics: data processed per second and data processed per Joule as two complementary metrics for evaluating cloud computing systems. We detail the design of CloudRank-D that considers representative applications, diversity of data characteristics, and dynamic behaviors of both applications and system software platforms. Through experiments, we demonstrate the advantages of our proposed metrics. In several case studies, we evaluate two small-scale deployments of cloud computing systems using CloudRank-D.
Keywords:
data center systems
clouds
big data applications
benchmarks
evaluation metrics

Journal

Frontiers of Computer Science cover
Frontiers of Computer Science
IF:
4.6
Papers:
1.6K
Citations:
2.8K

Organization

I
institute of computing technology, cas
Scholars:
1.0K
Papers: 877
Citations: 1
C
chinese academy of sciences
Scholars:
56.0W
Papers: 44.8W
Citations: 704