返回
A Contribution-Based Device Selection Scheme in Federated Learning
DOI:10.1109/LCOMM.2022.3181678.png)
摘要
En 中文
In a Federated Learning (FL) setup, a number of devices contribute to the training of a common model. We present a method for selecting the devices that provide updates in order to achieve improved generalization, fast convergence, and better device-level performance. We formulate a min-max optimization problem and decompose it into a primal-dual setup, where the duality gap is used to quantify the device-level performance. Our strategy combines exploration of data freshness through a random device selection with exploitation through simplified estimates of device contributions. This improves the performance of the trained model both in terms of generalization and personalization. A modified Truncated Monte-Carlo (TMC) method is applied during the exploitation phase to estimate the device's contribution and lower the communication overhead. The experimental results show that the proposed approach has a competitive performance, with lower communication overhead and competitive personalization performance against the baseline schemes.
Keyword:
Performance evaluation
Training
Data models
Computational modeling
Convergence
Costs
Servers
Federated learning
device selection
exploration
exploitation
personalization
generalization
期刊
IF:
4.4
论文数:
1.3W
被引数:
2.2W
机构
引用论文
Effect of sentence length and complexity on working memory performance in Hungarian children with specific language impairment (SLI): a cross‐linguistic comparison句子长度和复杂性对匈牙利特殊语言障碍 (SLI) 儿童工作记忆表现的影响: 跨语言比较
没有更多内容

