.png){kind=icon}
返回
Dynamic heterogeneous federated learning with multi-level prototypes
.png){kind=icon}
OA
AI
DOI：10.1016/j.patcog.2024.110542.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Federated learning shows promise as a privacy -preserving collaborative learning technique. Existing research mainly focuses on skewing the class distribution across clients. However, most approaches suffer from catastrophic forgetting and classifier shift, mainly when the global distribution of all classes is extremely unbalanced and the data distribution of the client dynamically evolves over time. In this paper, we study the Dynamic Heterogeneous Federated Learning, which addresses the practical scenario where heterogeneous data distributions exist among different clients and dynamic tasks within the client. Accordingly, we propose a novel federated learning framework named Federated Multi -Level Prototypes and design federated multi -level regularizations. To mitigate classifier shift, we construct semantic prototypes to provide fruitful generalization knowledge. To maintain the model stability and consistency convergence, three regularizations are introduced as training losses, i.e., prototype -based regularization, semantic prototype -based regularization, and federated inter -task regularization. Extensive experiments show that the proposed method achieves advanced performance in various settings.
Keyword:
Heterogeneous federated learning
Multi-level prototypes
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Feature Nonlinear Transformation Non-Negative Matrix Factorization with Kullback-Leibler Divergence具有Kullback-Leibler散度的特征非线性变换非负矩阵分解.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Doubly contrastive representation learning for federated image recognitionPATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Nitrogen Diffusion in Amorphous Silicon Nitride Isotope Multilayers Probed by Neutron ReflectometryOAAI
OAAI分享收藏Clustered Federated Learning: Model-Agnostic Distributed Multitask Optimization Under Privacy Constraints集群联邦学习: 隐私约束下的模型不可知的分布式多任务优化OAAI
OAAI分享收藏
查看更多内容