.png){kind=icon}
返回
Federated Learning Hyperparameter Tuning From a System Perspective
.png){kind=icon}
OA
AI
DOI：10.1109/JIOT.2023.3253813.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Federated learning (FL) is a distributed model training paradigm that preserves clients' data privacy. It has gained tremendous attention from both academia and industry. FL hyperparameters (e.g., the number of selected clients and the number of training passes) significantly affect the training overhead in terms of computation time, transmission time, computation load, and transmission load. However, the current practice of manually selecting FL hyperparameters imposes a heavy burden on FL practitioners because applications have different training preferences. In this article, we propose FedTune, an automatic FL hyperparameter tuning algorithm tailored to applications' diverse system requirements in FL training. FedTune iteratively adjusts FL hyperparameters during FL training and can be easily integrated into existing FL systems. Through extensive evaluations of FedTune for diverse applications and FL aggregation algorithms, we show that FedTune is lightweight and effective, achieving 8.48%-26.75% system overhead reduction compared to using fixed FL hyperparameters. This article assists FL practitioners in designing high-performance FL training solutions. The source code of FedTune is available at https://github.com/DataSysTech/FedTune.
Keyword:
Federated learning (FL)
hyperparameter tuning
optimization
system overhead
training preference
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
分享收藏Parity affects the relationship between the insemination–ovulation interval and the conception rate in lactating dairy cows胎次影响授精-排卵间隔与泌乳奶牛受胎率之间的关系
PREAI
分享收藏On hyperparameter optimization of machine learning algorithms: Theory and practice机器学习算法的超参数优化: 理论与实践.png)
NEUROCOMPUTING
OAAI
NEUROCOMPUTINGIF6.5
OAAI分享收藏Single-step genome-wide association studies and post-GWAS analyses for the number of oocytes and embryos in Gir cattle单步全基因组关联研究及后GWAS分析在Gir牛卵母细胞和胚胎数量上的应用OAAI
OAAI分享收藏Machine Learning Applications for Precision Agriculture: A Comprehensive Review机器学习在精准农业中的应用: 综合评述IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏A Smartphone-Enabled Fall Detection Framework for Elderly People in Connected Home HealthcareIEEE NETWORK
IEEE NETWORKIF6.3
PREAI
分享收藏
查看更多内容