arrow
Return

Google hostload prediction based on Bayesian model with optimized feature combination

delete2014-01-01
delete43
PRE
AI
S
Sheng Di *
DOI:10.1016/j.jpdc.2013.10.001delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We design a novel prediction method with Bayes model to predict a. load fluctuation pattern over a long-term interval, in the context of Google data centers. We exploit a set of features that capture the expectation, trend, stability and patterns of recent host loads. We also investigate the correlations among these features and explore the most effective combinations of features with various training periods. All of the prediction methods are evaluated using Google trace with 10,000+ heterogeneous hosts. Experiments show that our Bayes method improves the long-term load prediction accuracy by 5.6%-50%, compared to other state-of-the-art methods based on moving average, auto-regression, and/or noise filters. Mean squared error of pattern prediction with Bayes method can be approximately limited in [10(-8), 10(-5)]. Through a load balancing scenario, we confirm the precision of pattern prediction in finding a set of idlest/busiest hosts from among 10,000+ hosts can be improved by about 7% on average. (C) 2013 Elsevier Inc. All rights reserved.
Keywords:
Hostload prediction
Bayesian model
Google data center

Journal

Journal of Parallel and Distributed Computing cover
Journal of Parallel and Distributed Computing
IF:
4
Papers:
3.8K
Citations:
4.8K

Organization

A
alphabet inc.
Scholars:
1.1K
Papers: 663
Citations: 0
I
Inria
Scholars:
3.5K
Papers: 2.5K
Citations: 343
Cited Papers

Cited Papers

Severe autonomic nervous system imbalance in Lennox-Gastaut syndrome patients demonstrated by heart rate variability recordings
err2021-11-01
err0
PREAI
errS. Hödl; E. Olbert; C. Mahringer; E. Carrette; A. Meurs; S. Gadeyne; I. Dauwe; L. Goossens; R. Raedt; P. Boon; K. Vonck
errShare
errSave
Not so naive Bayes: Aggregating one-dependence estimators
err2005-01-01
err518
errOAAI
errWebb, GI; Boughton, JR; Wang, ZH
errShare
errSave
Wind–wave characterization and modeling in the Azores Archipelago
err2022-11-01
err0
errOAAI
errNuno M.R. Monteiro; Tiago C.A. Oliveira; Paulo A. Silva; Ali Abdolali
errShare
errSave
Oxidative Stress And Flow-Mediated Dilation During Incremental Handgrip Exercise In Multiple Sclerosis
err2011-05-01
err0
errOAAI
errAnette S. Fjeldstad; John McDaniel; Steve J. Ives; Melissa A.H. Witman; Jia Zhao; John W Rose; Russell S. Richardson
errShare
errSave
GSODR: Global Summary Daily Weather Data in R
err2017-02-03
err0
errOAAI
errAdam H Sparks; Tomislav Hengl; Andrew Nelson
errShare
errSave
researcher View more