arrow
Return

Coded Decentralized Learning With Gradient Descent for Big Data Analytics

delete2020-02-01
delete6
PRE
AI
J
Jing Yue *
M
Ming Xiao
DOI:10.1109/LCOMM.2019.2930513delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Machine learning is an effective technique for big data analytics. We focus on the study of big data analytics with decentralized learning in large-scale networks. Fountain codes are applied to the decentralized learning process to reduce communication load for exchanging intermediate learning parameters among fog nodes. Two scenarios, i.e., disjoint datasets and overlapping datasets, are analyzed. Comparison results show that communication load can be reduced significantly by the Fountain-based scheme for large-scale networks, especially when the quality of communication links is relatively bad and/or the number of fog nodes is large.
Keywords:
Big Data
Encoding
Decoding
1
f noise
Task analysis
Generators
Machine learning
Big data
decentralized learning
gradient descent
Fountain codes
communication load
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Communications Letters cover
IEEE Communications Letters
IF:
4.4
Papers:
1.3W
Citations:
2.2W

Organization

R
RISE Research Institutes of Sweden
Scholars:
1.9K
Papers: 1.5K
Citations: 2.5K
R
Royal Institute of Technology
Scholars:
1.8W
Papers: 1.8W
Citations: 25
Cited Papers

Cited Papers

Strain release is not enough
err1996-07-01
err0
PREAI
errAriel Sella; Harold Basch; Shmaryahu Hoz
errShare
errSave
Pulsed growth of fungal hyphal tips.
err1994-12-06
err0
errOAAI
errR López-Franco; S Bartnicki-Garcia; C E Bracker
errShare
errSave
The Viking Landing Sites: Selection and Certification
err1976-08-27
err0
PREAI
errH. Masursky; N. L. Crabill
errShare
errSave
Probucol prevents atrial ion channel remodeling in an alloxan-induced diabetes rabbit model
err2016-11-14
err0
errOAAI
errHuaying Fu; Guangping Li; Changle Liu; Jian Li; Lijun Cheng; Wansong Yang; Gary Tse; Jichao Zhao; Tong Liu
errShare
errSave
Block-Diagonal and LT Codes for Distributed Computing With Straggling Servers
err2019-03-01
err65
errOAAI
errSeverinson, Albin; Graell i Amat, Alexandre; Rosnes, Eirik
errShare
errSave
Machine Learning With Big Data: Challenges and Approaches
err2017-01-01
err552
errOAAI
errL'Heureux, Alexandra; Grolinger, Katarina; Elyamany, Hany F.; Capretz, Miriam A. M.
errShare
errSave
researcher View more