arrow
返回

A Contribution-Based Device Selection Scheme in Federated Learning

delete2022-09-01
delete11
delete
OA
AI
S
Shashi Raj Pandey *
L
Lam Duc Nguyen
P
Petar Popovski
DOI:10.1109/LCOMM.2022.3181678delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In a Federated Learning (FL) setup, a number of devices contribute to the training of a common model. We present a method for selecting the devices that provide updates in order to achieve improved generalization, fast convergence, and better device-level performance. We formulate a min-max optimization problem and decompose it into a primal-dual setup, where the duality gap is used to quantify the device-level performance. Our strategy combines exploration of data freshness through a random device selection with exploitation through simplified estimates of device contributions. This improves the performance of the trained model both in terms of generalization and personalization. A modified Truncated Monte-Carlo (TMC) method is applied during the exploitation phase to estimate the device's contribution and lower the communication overhead. The experimental results show that the proposed approach has a competitive performance, with lower communication overhead and competitive personalization performance against the baseline schemes.
Keyword:
Performance evaluation
Training
Data models
Computational modeling
Convergence
Costs
Servers
Federated learning
device selection
exploration
exploitation
personalization
generalization

期刊

IEEE Communications Letters 封面图
IEEE Communications Letters
IF:
4.4
论文数:
1.3W
被引数:
2.2W

机构

A
aalborg university
学者数:
1.6W
论文数: 1.7W
被引数: 22
引用论文

引用论文

err分享
err收藏
A Crowdsourcing Framework for On-Device Federated Learning
err2020-05-01
err212
errOAAI
errPandey, Shashi Raj; Tran, Nguyen H.; Bennis, Mehdi; Tun, Yan Kyaw; Manzoor, Aunas; Hong, Choong Seon
err分享
err收藏
Multi-Armed Bandit-Based Client Scheduling for Federated Learning基于多臂强盗的联合学习客户端调度
err2020-11-01
err196
errOAAI
errXia, Wenchao; Quek, Tony Q. S.; Guo, Kun; Wen, Wanli; Yang, Howard H.; Zhu, Hongbo
err分享
err收藏
Edge-Assisted Democratized Learning Toward Federated Analytics
err2022-01-01
err15
errOAAI
errPandey, Shashi Raj; Nguyen, Minh N. H.; Tri Nguyen Dang; Tran, Nguyen H.; Thar, Kyi; Han, Zhu; Hong, Choong Seon
err分享
err收藏
Advances and Open Problems in Federated Learning联邦学习的进展和开放问题
err2021-01-01
err2.0K
PREAI
errKairouz, Peter; McMahan, H. Brendan; Avent, Brendan; Bellet, Aurelien; Bennis, Mehdi; Bhagoji, Arjun Nitin; Bonawitz, Kallista; Charles, Zachary; Cormode, Graham; Cummings, Rachel; D'Oliveira, Rafael G. L.; Eichner, Hubert; El Rouayheb, Salim; Evans, David; Gardner, Josh; Garrett, Zachary; Gascon, Adria; Ghazi, Badih; Gibbons, Phillip B.; Gruteser, Marco; Harchaoui, Zaid; He, Chaoyang; He, Lie; Huo, Zhouyuan; Hutchinson, Ben; Hsu, Justin; Jaggi, Martin; Javidi, Tara; Joshi, Gauri; Khodak, Mikhail; Konecny, Jakub; Korolova, Aleksandra; Koushanfar, Farinaz; Koyejo, Sanmi; Lepoint, Tancrede; Liu, Yang; Mittal, Prateek; Mohri, Mehryar; Nock, Richard; Ozgur, Ayfer; Pagh, Rasmus; Qi, Hang; Ramage, Daniel; Raskar, Ramesh; Raykova, Mariana; Song, Dawn; Song, Weikang; Stich, Sebastian U.; Sun, Ziteng; Suresh, Ananda Theertha; Tramer, Florian; Vepakomma, Praneeth; Wang, Jianyu; Xiong, Li; Xu, Zheng; Yang, Qiang; Yu, Felix X.; Yu, Han; Zhao, Sen
err分享
err收藏
没有更多内容