arrow
返回

Cascaded Coded Distributed Computing Schemes Based on Symmetric Designs

delete2022-11-01
delete3
PRE
AI
J
Jing Jiang *
W
Wenhan Wang
DOI:10.1109/TCOMM.2022.3211932delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Coded distributed computing (CDC) is an efficient method to reduce the communication load in general distributed computing frameworks such as MapReduce. In these systems, one usually needs to split the data set into disjoint files and design several output functions to complete a computational task. Li et al. provided some CDC schemes achieving optimal communication load. However, as the number of computing nodes increases, the numbers of input files and output functions of such schemes grow too fast to be applied in practice. In this paper, several infinite families of cascaded CDC schemes, where each output function is computed multiple times, are constructed by taking advantage of symmetric designs. Most importantly, the numbers of input files and output functions of each new scheme are linear with the number of computing nodes and the communication load of each new scheme approximates to that of the CDC scheme derived by Li et al. when the number of nodes becomes large.
Keyword:
Coded distributed computing
MapReduce
communication load
symmetric design

期刊

IEEE Transactions on Communications 封面图
IEEE Transactions on Communications
IF:
8.3
论文数:
1.2W
被引数:
3.6W

机构

G
Guangxi Normal University
学者数:
7.7K
论文数: 4.9K
被引数: 5.1K
引用论文

引用论文

Nuclear forward scattering of synchrotron radiation by deoxymyoglobin
err2000-05-19
err0
PREAI
errC. Keppler; K. Achterhold; A. Ostermann; U. van Bürck; A. I. Chumakov; R. Rüffer; W. Sturhahn; E. E. Alp; F. G. Parak
err分享
err收藏
Elektronendichte und Bindungsverhältnisse an invertierten Kohlenstoffatomen: eine experimentelle Studie an einem [1.1.1]Propellanderivat
err2005-06-10
err0
PREAI
errMarc Messerschmidt; Stephan Scheins; Lutz Grubert; Michael Pätzel; Günter Szeimies; Carsten Paulmann; Peter Luger
err分享
err收藏
Aqueous biphasic olefin hydroformylation catalyzed by water-soluble rhodium complexes
err2006-10-01
err0
PREAI
errTrino Suárez; Bernardo Fontal; Gustavo León; Marisela Reyes; Fernando Bellandi; Ricardo R. Contreras; Pedro Cancines
err分享
err收藏
Hydroformylation of Monosubstituted Alkenes Catalyzed by W–Rh Bimetallic Complex
err2006-04-22
err0
PREAI
errMotoki Yamane; Noriaki Yukimura; Hiroshi Ishiai; Koichi Narasaka
err分享
err收藏
Chiral (Diphosphonite)platinum Complexes in Asymmetric Hydroformylation
err2006-08-30
err0
errOAAI
errRuben van Duren; Leandra L. J. M. Cornelissen; Jarl Ivar van der Vlugt; Jeroen P. J. Huijbers; Allison M. Mills; Anthony L. Spek; Christian Müller; Dieter Vogt
err分享
err收藏
Pulsed growth of fungal hyphal tips.
err1994-12-06
err0
errOAAI
errR López-Franco; S Bartnicki-Garcia; C E Bracker
err分享
err收藏
Rhodium catalyzed hydroformylation of β-isophorone: An unexpected result
err2006-03-01
err0
PREAI
errStefano Paganelli; Federica Battois; Mauro Marchetti; Raffaello Lazzaroni; Roberta Settambolo; Silvia Rocchiccioli
err分享
err收藏
学者 查看更多内容