arrow
返回

Straggler Mitigation at Scale

delete2019-12-01
delete33
delete
OA
AI
M
Mehmet Fatih Aktaş *
E
Emina Soljanin
DOI:10.1109/TNET.2019.2946464delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Runtime performance variability has been a major issue, hindering predictable and scalable performance in modern distributed systems. Executing requests or jobs redundantly over multiple servers have been shown to be effective for mitigating variability, both in theory and practice. Systems that employ redundancy has drawn significant attention, and numerous papers have analyzed the pain and gain of redundancy under various service models and assumptions on the runtime variability. This paper presents a cost (pain) vs. latency (gain) analysis of executing jobs of many tasks by employing replicated or erasure coded redundancy. The tail heaviness of service time variability is decisive on the pain and gain of redundancy and we quantify its effect by deriving expressions for cost and latency. Specifically, we try to answer four questions: 1) How do replicated and coded redundancy compare in the cost vs. latency tradeoff? 2) Can we introduce redundancy after waiting some time and expect it to reduce the cost? 3) Can relaunching the tasks that appear to be straggling after some time help to reduce cost and/or latency? 4) Is it effective to use redundancy and relaunching together? We validate the answers we found for each of these questions via simulations that use empirical distributions extracted from a Google cluster data.
Keyword:
Task analysis
Redundancy
Runtime
Encoding
Computational modeling
Servers
Distributed computing
Coded and replicated redundancy
straggler relaunch
cost vs latency tradeoff in distributed computing
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE-ACM Transactions on Networking
IF:
3.6
论文数:
4.4K
被引数:
9.5K

机构

R
rutgers university system
学者数:
4.1W
论文数: 3.7W
被引数: 53
引用论文

引用论文

Combination of NVP-BEZ235 and Enzastaurin on B-Cell Lymphoma Cell Lines: An Effective Therapeutic Strategy
err2011-11-18
err0
PREAI
errMonica Civallero; Maria Cosenza; Samantha Pozzi; Stefano Sacchi
err分享
err收藏
Broadband Rectenna Arrays for Randomly Polarized Incident Waves
err2000-10-01
err0
PREAI
errJoseph A. Hagerty; Nestor D. Lopez; Branko Popovic; Zoya Popovic
err分享
err收藏
Intima-media thickness of common femoral vein is increased in Behçet's disease
err2023-05-01
err0
PREAI
errGizem Sevik; Rabia Ergelen; Seda Kutluğ Ağaçkıran; Haner Direskeneli; Fatma Alibaz-Oner
err分享
err收藏
A Better Model for Job Redundancy: Decoupling Server Slowdown and Job Size
err2017-12-01
err44
errOAAI
errGardner, Kristen; Harchol-Balter, Mor; Scheller-Wolf, Alan; Van Houdt, Benny
err分享
err收藏
Anisotropic Water-Mediated Proton Conductivity in Large Iron(II) Metal–Organic Framework Single Crystals for Proton-Exchange Membrane Fuel Cells
err2018-12-18
err0
PREAI
errHana Bunzen; Ali Javed; Danielle Klawinski; Anton Lamp; Maciej Grzywa; Andreas Kalytta-Mewes; Michael Tiemann; Hans-Albrecht Krug von Nidda; Thorsten Wagner; Dirk Volkmer
err分享
err收藏
err分享
err收藏
学者 查看更多内容