arrow
返回

Distributed Dispatching in the Parallel Server Model

delete2023-08-01
delete1
delete
OA
AI
G
Guy Goren
S
Shay Vargaftik *
Y
Yoram Moses
DOI:10.1109/TNET.2022.3220931delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the rapid increase in the size and volume of cloud services and data centers, architectures with multiple job dispatchers are quickly becoming the norm. Load balancing is a key element of such systems. Nevertheless, current solutions to load balancing in such systems admit a paradoxical behavior in which more accurate information regarding server queue lengths degrades performance due to herding and detrimental incast effects. Indeed, both in theory and in practice, there is a common doubt regarding the value of information in the context of multi-dispatcher load balancing. As a result, both researchers and system designers resort to more straightforward solutions, such as the power-of-two-choices to avoid worst-case scenarios, potentially sacrificing overall resource utilization and system performance. A principal focus of our investigation concerns the value of information about queue lengths in the multi-dispatcher setting. We argue that, at its core, load balancing with multiple dispatchers is a distributed computing task. In that light, we propose a new job dispatching approach, called Tidal Water Filling, which addresses the distributed nature of the system. Specifically, by incorporating the existence of other dispatchers into the decision-making process, our protocols outperform previous solutions in many scenarios. In particular, when the dispatchers have complete and accurate information regarding the server queues, our policies significantly outperform all existing solutions.
Keyword:
Load management
load modeling
queueing analysis
stability analysis
distributed computing
stochastic systems
Load management
load modeling
queueing analysis
stability analysis
distributed computing
stochastic systems

期刊

I
IEEE-ACM Transactions on Networking
IF:
3.6
论文数:
4.4K
被引数:
9.5K

机构

T
Technion Israel Institute of Technology
学者数:
1.6W
论文数: 1.5W
被引数: 2.0W
引用论文

引用论文

Magnetic behaviour of CuIn1-zFezS2
err1999-01-01
err0
PREAI
errR Brun del Re; G Lamarche; J C Woolley
err分享
err收藏
err分享
err收藏
P- and E-Selectins Recognize Sialyl 6-Sulfo Lewis X, the Recently Identified L-Selectin Ligand
err2000-11-01
err0
PREAI
errKatsuyuki Ohmori; Kayoko Kanda; Chikako Mitsuoka; Akiko Kanamori; Kazumi Kurata-Miura; Katsutoshi Sasaki; Tatsunari Nishi; Takuya Tamatani; Reiji Kannagi
err分享
err收藏
Nocifensive behaviors components evoked by brief laser pulses are mediated by C fibers
err2009-08-01
err0
PREAI
errRuey-Jane Fan; Jen-Chuang Kung; Bengt A. Olausson; Bai-Chung Shyu
err分享
err收藏
Do the Adjacent Level Intervertebral Discs Degenerate After a Lumbar Spinal Fusion?相邻节段椎间盘在腰椎融合术后会退变吗?
err2010-10-01
err0
PREAI
errKosaku Higashino; Takahiko Hamasaki; Jin Hwan Kim; Motohiro Okada; S. T. Yoon; Scott D. Boden; William C. Hutton
err分享
err收藏
The Tail at Scale在规模的尾巴
err2013-02-01
err1.2K
PREAI
errDean, Jeffrey; Barroso, Luiz Andre
err分享
err收藏
学者 查看更多内容