arrow
Return

Optimizing Quality-Aware Big Data Applications in the Cloud

delete2021-04-01
delete6
delete
OA
AI
E
Eugenio Gianniti *
M
Michele Ciavotta
D
Danilo Ardagna
DOI:10.1109/TCC.2018.2874944delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The last years witnessed a steep rise in data generation worldwide and, consequently, the widespread adoption of software solutions able to support data-intensive application. Competitiveness and innovation have strongly benefited from these new platforms and methodologies, and there is a great deal of interest around the new possibilities that Big Data analytics promise to make reality. Many companies currently engage in data-intensive processes as part of their core businesses; however, fully embracing the data-driven paradigm is still cumbersome, and establishing a production-ready, fine-tuned deployment is time-consuming, expensive, and resource-intensive. This situation calls for innovative models and techniques to streamline the process of deployment configuration for Big Data applications. In particular, the focus in this paper is on the rightsizing of Cloud deployed clusters, which represent a cost-effective alternative to installation on premises. This paper proposes a novel tool, integrated in a wider DevOps-inspired approach, implementing a parallel and distributed simulation-optimization technique that efficiently and effectively explores the space of alternative Cloud configurations, seeking the minimum cost deployment that satisfies quality of service constraints. The soundness of the proposed solution has been thoroughly validated in a vast experimental campaign encompassing different applications and Big Data platforms.
Keywords:
Nonlinear programming
performance of systems
distributed systems
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
IEEE Transactions on Cloud Computing
IF:
5
Papers:
1.9K
Citations:
4.3K

Organization

P
Polytechnic University of Milan
Scholars:
2.0W
Papers: 1.8W
Citations: 24
U
university of milano-bicocca
Scholars:
2.0W
Papers: 1.5W
Citations: 22
Cited Papers

Cited Papers

VEGF induces signalling and angiogenesis by directing VEGFR2 internalisation through macropinocytosis
err2016-11-15
err0
errOAAI
errDimitris Basagiannis; Sofia Zografou; Carol Murphy; Theodore Fotsis; Lucia Morbidelli; Marina Ziche; Christopher Bleck; Jason Mercer; Savvas Christoforidis
errShare
errSave
errShare
errSave
Ascorbyl palmitate as a carrier of ascorbate into neural tissues
err2003-03-01
err0
PREAI
errMieczysław Pokorski; Magdalena Marczak; Aneta Dymecka; Piotr Suchocki
errShare
errSave
Trajectory Prediction of Workers to Improve AGV and AMR Operation based on the Manufacturing Schedule
err2022-01-01
err0
errOAAI
errAndreas Löcklin; Falk Dettinger; Maurice Artelt; Nasser Jazdi; Michael Weyrich
errShare
errSave
Fabrication of low-cost Quantum Dot Sensitized Solar cells (QDSSCs)
err2024-01-01
err0
errOAAI
errAmira Ebaid; Ahmed El-Hamalawy; Meawad ElKholy; Shaker Ebrahim; Jehan El-Nady
errShare
errSave
Mutations of the CYP21 Gene in Nonclassical Steroid 21-Hydroxylase Deficiency in Japan.
err1998-01-01
err0
errOAAI
errTOSHIHIRO TAJIMA; KENJI FUJIEDA; JUN NAKAE; ATUSHI MIKAMI; GORDON B. CUTLER
errShare
errSave
researcher View more