.png){kind=icon}
返回
Communication Efficient Federated Learning With Heterogeneous Structured Client Models
.png){kind=icon}
PRE
AI
DOI：10.1109/TETCI.2022.3209345.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Federated learning (FL) has recently attracted much attention due to its superior performance in privacy protection when processing data from different terminals. However, homogeneous deep learning models are pervasively adopted without considering the difference between distinct data in various clients, resulting in low learning performance and high communication costs. This paper thus proposes a novel FL framework with heterogeneous structured client models for handling different data scales and investigates its superiority over canonical FL with homogeneous models. Additionally, singular value decomposition is adopted on the client models to reduce the amount of transmitted data, i.e., the communication costs. The aggregation mechanism with multiple models on the central server is then presented based on the heterogeneous characteristics of the uploaded parameters and models. The proposed framework is applied to four benchmark classification datasets and a trend following task on electromagnetic radiation intensity time series data. Experimental results demonstrate that the proposed method can effectively improve the accuracy of local learning models and significantly reduce communication costs.
Keyword:
Servers
Costs
Matrix decomposition
Training
Data models
Optimization
Data privacy
Federated learning
heterogeneous structured model
neural network
singular value decomposition
期刊
I
IF:
6.5
论文数:
1.4K
被引数:
4.5K
机构
引用论文
Determinants of the Intention to Protect Personal Information among Facebook Users.png)
ETRI Journal
OAAI
ETRI JournalIF0
OAAI分享收藏Cap Layer Effect on Key Features of Persistent Photoconductivity Spectra in HgTe/CdHgTe Double Quantum Well HeterostructuresPhotonics
OAAI
PhotonicsIF0
OAAI分享收藏Communication-Efficient Federated Deep Learning With Layerwise Asynchronous Model Update and Temporally Weighted Aggregation具有分层异步模型更新和时间加权聚合的高效通信联合深度学习OAAI
OAAI分享收藏Economic benefit evaluation method for the micro-grid renewable energy system operation微网可再生能源系统运行经济效益评价方法
PREAI
分享收藏分享收藏
查看更多内容