arrow
Return

A multi-layered performance analysis for cloud-based topic detection and tracking in Big Data applications

delete2018-10-01
delete11
delete
OA
AI
M
Meisong Wang
P
Prem Prakash Jayaraman
E
Ellis Solaiman *
L
Lydia Y. Chen
Z
Zheng Li
J
Jun Song
D
Dimitrios Georgakopoulos
R
Rajiv Ranjan
DOI:10.1016/j.future.2018.01.047delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In the era of the Internet of Things and social media; communities, governments, and corporations are increasingly eager to exploit new technological innovations in order to track and keep up to date with important new events. Examples of such events include the news, health related incidents, and other major occurrences such as earthquakes and landslides. This area of research commonly referred to as Topic Detection and Tracking (TDT) is proving to be an important component of the current generation of Internet-based applications, where it is of critical importance to have early detection and timely response to important incidents such as those mentioned above. The advent of Big data though beneficial to TDT applications also brings about the enormous challenge of dealing with data variety, velocity and volume (3Vs). A promising solution is to employ Cloud Computing, which enables users to access powerful and scalable computational and storage resources in a pay-as-you-go fashion. However, the efficient use of Cloud resources to boost the performance of mission critical applications employing TDT is still an open topic that has not been fully and effectively investigated. An important prerequisite is to build a performance analysis capable of capturing and explaining specific factors (for example; CPU, Memory, I/O, Network, Cloud Platform Service, and Workload) that influence the performances of TDT applications in the cloud. Within this paper, our main contribution, is that we present a multi-layered performance analysis for big data TDT applications deployed in a cloud environment. Our analysis captures factors that have an important effect on the performance of TDT applications. The novelty of our work is that it is a first kind of vertical analysis on infrastructure, platform and software layers. We identify key parameters and metrics in each cloud layer (including Infrastructure, Software, and Platform layers), and establish the dependencies between these metrics across the layers. We demonstrate the effectiveness of the proposed analysis via experimental evaluations using real-world datasets obtained from Twitter. (C) 2018 Elsevier B.V. All rights reserved.
Keywords:
Cloud-based TDT
Big Data
Performance analysis
Cloud computing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
Papers:
6.8K
Citations:
2.3W

Organization

N
newcastle university - uk
Scholars:
2.9W
Papers: 2.6W
Citations: 39
A
Australian National University
Scholars:
2.1W
Papers: 2.3W
Citations: 3.9W
L
lund university
Scholars:
4.1W
Papers: 3.9W
Citations: 54
S
Swinburne University of Technology
Scholars:
9.3K
Papers: 1.2W
Citations: 2.0W
I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
I
ibm switzerland
Scholars:
298
Papers: 203
Citations: 0
researcher View more organizations