.png){kind=icon}
返回
Federated learning with stochastic quantization
.png){kind=icon}
PRE
AI
DOI：10.1002/int.23056.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper studies the distributed federated learning problem when the exchanged information between the server and the workers is quantized. A novel quantized federated averaging algorithm is developed by applying stochastic quantization scheme to the local and global model parameters. Specifically, the server broadcasts the quantized global model parameter to the workers; the workers update local model parameters using their own data sets and upload the quantized version to the server; then the server updates the global model parameter by aggregating all the quantized local model parameters and its previous global model parameter. This algorithm can be interpreted as a quantized variant of the federated averaging algorithm. The convergence is analyzed theoretically for both convex and strongly convex loss functions with Lipschitz gradient. Extensive experiments using realistic data are provided to show the effectiveness of the proposed algorithm.
Keyword:
distributed optimization
federated learning
quantization
stochastic gradient descent
期刊
IF:
3.7
论文数:
3.1K
被引数:
8.1K
机构
引用论文
.png){kind=icon}
分享收藏Federated Learning With Cooperating Devices: A Consensus Approach for Massive IoT Networks与协作设备的联合学习: 大规模物联网网络的共识方法
OAAI
OAAI分享收藏
查看更多内容