arrow
Return

Distributed, application-level monitoring for heterogeneous clouds using stream processing

delete2013-10-01
delete33
PRE
AI
M
Michael Smit *
B
Bradley Simmons
M
Marin Litoiu
DOI:10.1016/j.future.2013.01.009delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As utility computing is widely deployed, organizations and researchers are turning to the next generation of cloud systems: federating public clouds, integrating private and public clouds, and merging resources at all levels (IaaS, PaaS, SaaS). Adaptive systems can help address the challenge of managing this heterogeneous collection of resources. While services and libraries exist for basic management tasks that enable implementing decisions made by the manager, monitoring is an open challenge. We define a set of requirements for aggregating monitoring data from a heterogeneous collections of resources, sufficient to support adaptive systems. We present and implement an architecture using stream processing to provide near-realtime, cross-boundary, distributed, scalable, fault-tolerant monitoring. A case study illustrates the value of collecting and aggregating metrics from disparate sources. A set of experiments shows the feasibility of our prototype with regard to latency, overhead, and cost effectiveness. (C) 2013 Elsevier B.V. All rights reserved.
Keywords:
Cloud computing
Monitoring
Utility computing
Distributed
Monitoring-as-a-Service

Journal

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
Papers:
6.8K
Citations:
2.3W

Organization

Y
york university - canada
Scholars:
8.3K
Papers: 9.0K
Citations: 10