arrow
返回

Deadline-Aware Coded Computation Across Homogeneous Workers

delete2023-01-01
delete0
PRE
AI
M
Mehrad Mehrabi *
M
Maryam Haghighi Ardakani
M
Masoud Ardakani
DOI:10.1109/LSP.2023.3299531delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Distributed computing systems have been widely used in recent years to handle massive computations required by newly emerged machine learning algorithms and signal processing problems. In practice, a distributed computing system often receives multiple tasks each needs to be finished by a specific deadline. This necessitates use of a task scheduler which orders and prioritizes tasks executions. In this work, we consider task scheduling for a homogeneous distributed computing system with multiple matrix-vector multiplication jobs, and try to maximize the number of tasks completed before their deadlines. The main challenges in such a system are random task arrivals and random execution times due to the straggling effect. To address these challenges, we propose two task scheduling algorithms namely simple greedy and farsighted greedy and compare their performance with the ultimate upper bound, i.e., a genie-aided algorithm that knows the exact arrival and execution times of all tasks. Our simulation results demonstrate that the proposed algorithms can approach the performance of the genie-aided algorithm.
Keyword:
Coded distributed computing
task scheduling
random task arrival
task allocation
coding rate

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

U
university of alberta
学者数:
5.1W
论文数: 4.9W
被引数: 65
引用论文

引用论文

Rateless Codes for Near-Perfect Load Balancing in Distributed Matrix-Vector Multiplication
err2022-04-25
err9
errOAAI
errMallick, Ankur; Chaudhari, Malhar; Sheth, Utsav; Palanikumar, Ganesh; Joshi, Gauri
err分享
err收藏
On Allocation of Systematic Blocks in Coded Distributed Computing关于编码分布式计算中系统块的分配
err2022-04-01
err8
PREAI
errArdakani, Maryam Haghighi; Mehrabi, Mehrad; Ardakani, Masoud; Tellambura, Chintha
err分享
err收藏
Amino‐phosphanes in RhI‐Catalyzed Hydroformylation: Hemilabile Behavior of P,N Ligands under High CO Pressure and Catalytic Properties
err2005-12-22
err0
errOAAI
errJacques Andrieu; Jean‐Michel Camus; Philippe Richard; Rinaldo Poli; Luca Gonsalvi; Francesco Vizza; Maurizio Peruzzini
err分享
err收藏
err分享
err收藏
Pulsed growth of fungal hyphal tips.
err1994-12-06
err0
errOAAI
errR López-Franco; S Bartnicki-Garcia; C E Bracker
err分享
err收藏
Perineural Invasion as a Clue to Malignant Behavior in a Dermatofibroma
err2019-11-12
err0
PREAI
errAngel Santos-Briz; Juan García-Gavín; Ievgenia Pastushenko; José María Sayagués; José Luis Rodríguez-Peralto; Luis Requena
err分享
err收藏
学者 查看更多内容