.png){kind=icon}
返回
2D-SAZD: A Novel 2D Coded Distributed Computing Framework for Matrix-Matrix Multiplication
.png){kind=icon}
PRE
AI
DOI：10.1109/TSC.2024.3395931.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
By separating huge dimensional matrix-matrix multiplication at a single computing node into parallel small matrix multiplications (with appropriate encoding) at parallel worker nodes, coded distributed computing (CDC) tackles the straggler problem and hence speeds up the computation significantly. Existing CDC encoding schemes are based on linear combination (LC), which have two drawbacks: First, heavy computational burden is introduced to both encoding and decoding phases. Second, large numerical error occurs in the decoding phase. To relieve these two effects, a fresh new 2D-SAZD-CDC framework that non-trivially generalizes 1D-SAZD-CDC is proposed, where D is short for dimension, the operation for encoding and decoding is implemented by shift-and-add (SA) and zigzag decoding (ZD) that replaces LC and matrix inversion, respectively. The non-trivial generalization lies in joint design of the operations in 2D are needed in both the encoding and the decoding phases, so as to ensure possesion of combination property (CP) and ZD from 2D viewpoint. More specifically, 2D-SA encoding is designed, 2D-ZD decoding (alternates intermittently between 2D) is proposed, and a proof for satisfying CP and ZD from 2D viewpoint is also given. Numerical studies show that 2D-SAZD-CDC significantly improves the numerical stability and computational load performance over existing LC based schemes.
Keyword:
Encoding
Decoding
Matrices
Numerical stability
Task analysis
Internet of Things
Indexes
Coded distributed computing (CDC)
shift-and-add (SA)
zigzag decoding (ZD)
two dimension encoding/decoding
matrix-matrix multiplication
期刊
IF:
5.8
论文数:
2.2K
被引数:
6.5K
机构
引用论文
.png){kind=icon}
Scenario-Based AI Benchmark Evaluation of Distributed Cloud/Edge Computing Systems基于场景的分布式云/边缘计算系统AI基准评估
PREAI
分享收藏分享收藏
查看更多内容