arrow
Return

Green Cloud Software Engineering for Big Data Processing

delete2020-11-07
delete20
delete
OA
AI
M
Madhubala Ganesan
A
Ah-Lian Kor
C
Colin Pattinson
É
Éric Rondeau *
DOI:10.3390/su12219255delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Internet of Things (IoT) coupled with big data analytics is emerging as the core of smart and sustainable systems which bolsters economic, environmental and social sustainability. Cloud-based data centers provide high performance computing power to analyze voluminous IoT data to provide invaluable insights to support decision making. However, multifarious servers in data centers appear to be the black hole of superfluous energy consumption that contributes to 23% of the global carbon dioxide (CO2) emissions in ICT (Information and Communication Technology) industry. IoT-related energy research focuses on low-power sensors and enhanced machine-to-machine communication performance. To date, cloud-based data centers still face energy-related challenges which are detrimental to the environment. Virtual machine (VM) consolidation is a well-known approach to affect energy-efficient cloud infrastructures. Although several research works demonstrate positive results for VM consolidation in simulated environments, there is a gap for investigations on real, physical cloud infrastructure for big data workloads. This research work addresses the gap of conducting real physical cloud infrastructure-based experiments. The primary goal of setting up a real physical cloud infrastructure is for the evaluation of dynamic VM consolidation approaches which include integrated algorithms from existing relevant research. An open source VM consolidation framework, Openstack NEAT is adopted and experiments are conducted on a Multi-node Openstack Cloud with Apache Spark as the big data platform. Open sourced Openstack has been deployed because it enables rapid innovation, and boosts scalability as well as resource utilization. Additionally, this research work investigates the performance based on service level agreement (SLA) metrics and energy usage of compute hosts. Relevant results concerning the best performing combination of algorithms are presented and discussed.
Keywords:
big data analytics
cloud data centers
VM consolidation
energy consumption
IoT
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Sustainability cover
Sustainability
IF:
3.3
Papers:
10.7W
Citations:
28.4W

Organization

L
Leeds Beckett University
Scholars:
2.1K
Papers: 2.1K
Citations: 1.6K
U
universite de lorraine
Scholars:
1.8W
Papers: 1.4W
Citations: 27
Cited Papers

Cited Papers

Microarray-based detection of antibodies against SARS-CoV-2 proteins, common respiratory viruses and type I interferons
err
IF0
err2021-12-14
err0
errOAAI
errElena Savvateeva; Marina Filippova; Vladimir Valuev-Elliston; Nurana Nuralieva; Marina Yukina; Ekaterina Troshina; Vladimir Baklaushev; Alexander Ivanov; Dmitry Gryadunov
errShare
errSave
Microtiter method to monitor Corynespora cassiicola and sensitivity of the pathogen to carbendazim, prothioconazole and pyraclostrobin
err2021-06-01
err0
errOAAI
errSheila Ariana Xavier; Flávia Elis de Mello; Helen Prudente da Silva; Marcelo Giovanetti Canteri; Lucimara Junko Koga; Ivani de Oliveira Negrão Lopes; Claudia Vieira Godoy
errShare
errSave
Post-Vaccination Symptoms after A Third Dose of mRNA SARS-CoV-2 Vaccination in Patients with Inflammatory Bowel Disease
err
IF0
err2021-12-07
err0
errOAAI
errDalin Li; Philip Debbas; Susan Cheng; Jonathan Braun; Dermot P.B. McGovern; Gil Y. Melmed
errShare
errSave
Energy-efficient virtual machine consolidation algorithm in cloud data centers
err2017-11-11
err20
PREAI
errZhou Zhou; Hu Zhi-gang; Yu Jun-yang; Abawajy, Jemal; Chowdhury, Morshed
errShare
errSave
researcher View more