返回
Exploiting data diversity in multi-domain federated learning
DOI:10.1088/2632-2153/ad4768.png)
摘要
En 中文
Federated learning (FL) is an evolving machine learning technique that allows collaborative model training without sharing the original data among participants. In real-world scenarios, data residing at multiple clients are often heterogeneous in terms of different resolutions, magnifications, scanners, or imaging protocols, and thus challenging for global FL model convergence in collaborative training. Most of the existing FL methods consider data heterogeneity within one domain by assuming same data variation in each client site. In this paper, we consider data heterogeneity in FL with different domains of heterogeneous data by raising the problems of domain-shift, class-imbalance, and missing data. We propose a method, multi-domain FL as a solution to heterogeneous training data from multiple domains by training robust vision transformer model. We use two loss functions, one for correctly predicting class labels and other for encouraging similarity and dissimilarity over latent features, to optimize the global FL model. We perform various experiments using different convolution-based networks and non-convolutional Transformer architectures on multi-domain datasets. We evaluate the proposed approach on benchmark datasets and compare with the existing FL methods. Our results show the superiority of the proposed approach which performs better in term of robust FL global model than the exiting methods.
Keyword:
class-imbalance
data heterogeneity
domain-shift
federated learning
multi-domain data
期刊
M
IF:
4.6
论文数:
1.1K
被引数:
3.4K
机构
引用论文
A systematic study of the class imbalance problem in convolutional neural networks卷积神经网络中类不平衡问题的系统研究
NEURAL NETWORKS
IF6.3
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent使用新型MIL-53(Fe) 作为高效吸附剂通过吸附从水溶液中去除砷
RSC Advances
IF0
Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data医学联合学习: 在不共享患者数据的情况下促进多机构合作
SCIENTIFIC REPORTS
IF3.9
SplitAVG: A Heterogeneity-Aware Federated Deep Learning Method for Medical ImagingSplitAVG: 一种异构感知的医学影像联合深度学习方法
Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用
PROCEEDINGS OF THE IEEE
IF25.9

