.png){kind=icon}
返回
On Distributed Computing With Heterogeneous Communication Constraints
.png){kind=icon}
PRE
AI
DOI：10.1109/TNET.2022.3181234.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We consider a distributed computing framework where the distributed nodes have different communication capabilities, motivated by the heterogeneous networks in data centers and mobile edge computing systems. Following the structure of MapReduce, this framework consists of Map computation phase, Shuffle phase, and Reduce computation phase. The Shuffle phase allows distributed nodes to exchange intermediate values, in the presence of heterogeneous communication bottlenecks for different nodes (heterogeneous communication load constraints). For this setting, we characterize the minimum total computation load and the minimum worst-case computation load in some cases, under the heterogeneous communication load constraints. While the total computation load depends on the sum of the computation loads of all the nodes, the worst-case computation load depends on the computation load of a node with the heaviest job. We show an interesting insight that, for some cases, there is a tradeoff between the minimum total computation load and the minimum worst-case computation load, in the sense that both cannot be achieved at the same time. The achievability schemes are proposed with careful design on the file assignment and the data shuffling. Beyond the cut-set bound, a novel converse is proposed using the proof by contradiction. For the general case, we identify two extreme regimes in which both the scheme with coding and the scheme without coding are optimal, respectively.
Keyword:
Distributed computing
heterogeneous com-munication constraints
MapReduce
coded distributed computing
worst-case computation load
proof by contradiction
information-theoretical bound
期刊
I
IF:
3.6
论文数:
4.4K
被引数:
9.5K
机构
引用论文
Geochemical anomaly definition using multifractal modeling, validated by geological field observations: Siah Jangal area, SE Iran.png)
Geochemistry
GeochemistryIF0
PREAI
分享收藏
Synthesis and Structure of a Mononuclear η2‐Hydrazine Complex by Protonation of an [N2H2]2− Complex
PREAI
分享收藏
查看更多内容