arrow
Return

Modeling, classifying and generating large-scale Google-like workload

delete2018-09-01
delete11
delete
OA
AI
G
Georges Da Costa *
L
Léo Grange
I
Inès de Courchelle
DOI:10.1016/j.suscom.2017.12.004delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
One of the key elements needed to test most large-scale scheduling algorithms is a testing infrastructure. Large scale is of upmost importance as failures and complex behaviors are common occurrences only at such scale. In order to test the reaction of a system to failures or extreme behaviors, it is necessary to be able to create large scale environments. Such an infrastructure must be reproducible so that several studies are able to compare themselves but also capable of diversity as otherwise it would risk to limit them to particular subcases. In this article, we propose a generic adaptable and reusable model of large scale workload. The original schema comes from the Google Cluster Workload Traces which is a perfect representative of large scale production workload. The methodology to produce the model can be used at different precision levels and can classify the input level without human supervision. Contrary to most model analysis of such traces, we propose along with our model a reference implementation in order for other studies using our results to produce comparable experiments. (C) 2018 Elsevier Inc. All rights reserved.
Keywords:
Workload analysis
Workload generation
Classification
Large scale
Google dataset
Reproducible experiments
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

S
Sustainable Computing-Informatics and Systems
IF:
5.7
Papers:
966
Citations:
2.9K

Organization

U
universite de toulouse
Scholars:
3.5W
Papers: 2.7W
Citations: 37