arrow
Return

Data Center Scheduling With Network Tasks

delete2025-06-23
delete0
PRE
AI
F
Frédéric Giroire
N
Nicolas Huin
A
Andrea Tomassilli
DOI:10.1109/TON.2025.3578455delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We consider the placement of jobs inside a data center. Traditionally, this is done by a task orchestrator without taking into account network constraints. According to recent studies, network transfers may account for up to 50% of the completion time of classical jobs. Thus, network resources must be considered when placing jobs in a data center. In this paper, we propose a new scheduling framework, introducing network tasks that need to be executed on network machines alongside traditional (CPU) tasks. The model takes into account the competition between communications for the network resources, which is not considered in the formerly proposed scheduling models with communication. Network transfers inside a data center can be easily modeled in our framework. As we show, classical algorithms do not efficiently handle a limited amount of network bandwidth. We thus propose new provably efficient algorithms with the goal of minimizing the makespan in this framework. We show their efficiency and the importance of taking into consideration network capacity through extensive simulations on workflows built from Google data center traces.
Keywords:
Scheduling algorithms
data centers
network-aware scheduling
communication modeling
approximation algorithms

Journal

I
IEEE Transactions on Networking
IF:
0
Papers:
551
Citations:
0

Organization

Cited Papers

Cited Papers

VL2
err2009-08-16
err0
PREAI
errAlbert Greenberg; James R. Hamilton; Navendu Jain; Srikanth Kandula; Changhoon Kim; Parantap Lahiri; David A. Maltz; Parveen Patel; Sudipta Sengupta
errShare
errSave
Dcell
err2008-08-17
err0
PREAI
errChuanxiong Guo; Haitao Wu; Kun Tan; Lei Shi; Yongguang Zhang; Songwu Lu
errShare
errSave
Towards Practical and Near-Optimal Coflow Scheduling for Data Center Networks
err2016-11-01
err51
PREAI
errLuo, Shouxi; Yu, Hongfang; Zhao, Yangming; Wang, Sheng; Yu, Shui; Li, Lemin
errShare
errSave
Decentralized task-aware scheduling for data center networks
err2014-08-17
err0
PREAI
errFahad R. Dogar; Thomas Karagiannis; Hitesh Ballani; Antony Rowstron
errShare
errSave
Fast Approximate Graph Partitioning Algorithms
err1999-01-01
err0
PREAI
errGuy Even; Joseph (Seffi) Naor; Satish Rao; Baruch Schieber
errShare
errSave
Coflow
err2012-10-29
err0
PREAI
errMosharaf Chowdhury; Ion Stoica
errShare
errSave
researcher View more