arrow
返回

Squeezed Polynomial Codes: Communication-Efficient Coded Computation in Straggler-Exploiting Distributed Matrix Multiplication

delete2020-01-01
delete9
delete
OA
AI
S
Sangwoo Hong
H
Heecheol Yang *
J
Jungwoo Lee
DOI:10.1109/ACCESS.2020.3031590delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In a distributed computing environment, there may exist slow processing workers, which are known as stragglers and they can slow down the whole computing process. In this article, we consider coded computation for matrix multiplication tasks in distributed computing, which can mitigate the effect of stragglers by a coding approach. We propose a new communication-efficient coded computation scheme, namely squeezed polynomial codes, for a straggler-exploiting scenario where multiple sub-tasks are assigned to the workers to partially leverage the computation capability of stragglers. The key idea of squeezed polynomial codes is to overlap the encoded matrices in assigning multiple sub-tasks with appropriate polynomial functions in order to reduce the task-allocation communication load from a master to its workers. We compare squeezed polynomial codes with the existing schemes for distributed matrix multiplication in a communication load perspective. Consequently, we show that squeezed polynomial codes can efficiently reduce the communication load while ensuring the optimal recovery condition at a master to obtain final product.
Keyword:
Distributed computing
coded computation
matrix multiplication
polynomial codes
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

S
seoul national university (snu)
学者数:
7.2W
论文数: 6.6W
被引数: 86
K
kumoh national university technology
学者数:
1.6K
论文数: 1.7K
被引数: 3
引用论文

引用论文

Elektronendichte und Bindungsverhältnisse an invertierten Kohlenstoffatomen: eine experimentelle Studie an einem [1.1.1]Propellanderivat
err2005-06-10
err0
PREAI
errMarc Messerschmidt; Stephan Scheins; Lutz Grubert; Michael Pätzel; Günter Szeimies; Carsten Paulmann; Peter Luger
err分享
err收藏
Tyrosine phosphorylation in human neutrophil
err1989-08-01
err0
PREAI
errJulian Gomez-Cambronero; Chi-Kuang Huang; Valerie A. Bonak; Ellen Wang; John E. Casnellie; Tadayoshi Shiraishi; Ramadan I. Sha'afi
err分享
err收藏
Early Switch to Nilotinib Does Not Overcome the Adverse Outcome for CML Patients Failing to Achieve Early Molecular Response On Imatinib, Despite Excellent Overall Outcomes in the TIDEL II Trial
err2012-11-16
err0
PREAI
errDavid T Yeung; Michael Philip Osborn; Deborah L White; Susan Branford; Michael Kornhauser; Cassandra Slader; Samar Issa; Devendra K. Hiwase; Mark S. Hertzberg; Anthony P. Schwarer; Robin Filshie; Christopher K Arthur; Yiu Lam Kwan; Cecily J Forsyth; David Ross; Anthony K. Mills; Andrew Grigg; Timothy P. Hughes
err分享
err收藏
The Tail at Scale在规模的尾巴
err2013-02-01
err1.2K
PREAI
errDean, Jeffrey; Barroso, Luiz Andre
err分享
err收藏
Poly(ethyleneglycol) in electrospray ionization (ESI) mass spectrometry
err2000-05-01
err0
errOAAI
errS. Varray; J.-L. Aubagnac; F. Lamaty; R. Lazaro; J. Martinez; C. Enjalbal
err分享
err收藏
Small ring propellanes
err2002-05-01
err0
PREAI
errKenneth B. Wiberg
err分享
err收藏
err分享
err收藏
学者 查看更多内容