arrow
Return

Performance prediction of parallel computing models to analyze cloud-based big data applications

delete2017-11-23
delete6
PRE
AI
申超 (Chao Shen) *
W
Weiqin Tong
K
Kim‐Kwang Raymond Choo
S
Samina Kausar
DOI:10.1007/s10586-017-1385-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Performance evaluation of cloud center is a necessary prerequisite to fulfilling contractual quality of service, particularly in big data applications. However, effectively evaluating performance of cloud services is challenging due to the complexity of cloud services and the diversity of big data applications. In this paper, we propose a performance evaluation model for parallel computing models deployed in cloud centers to support big data applications. In this evaluation model, a big data application is divided into lots of parallel tasks and the task arrivals follow a general distribution. In our approach, we also consider factors associated with resource heterogeneity, resource contention among cloud nodes, and data storage strategy, which have an impact on the performance of parallel computing models. Our model also allows us to calculate key performance indicators of cloud center such as mean number of tasks in the system, probability that a task obtains immediate service, and task waiting time. The model can also be used to predict the time of performing applications. We then demonstrate the utility of the model based on simulations and benchmarking using WordCount and TeraSort applications.
Keywords:
Parallel computing model
Big data application
Cloud center
Performance modeling
Embedded Markov chain
Service time

Journal

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
Papers:
5.0K
Citations:
7.5K

Organization

C
China University of Geosciences
Scholars:
3.7W
Papers: 2.8W
Citations: 4.3W
H
Hebei University of Engineering
Scholars:
3.3K
Papers: 2.1K
Citations: 2.7K
S
shanghai university
Scholars:
3.9W
Papers: 2.7W
Citations: 52
researcher View more organizations