arrow
返回

Fair Federated Learning with Multi-Objective Hyperparameter Optimization

delete2024-08-21
delete0
PRE
AI
C
Chunnan Wang
X
Xiangyu Shi
王
王宏志 (Hongzhi Wang) *
DOI:10.1145/3676968delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Federated learning (FL) is an attractive paradigm for privacy-aware distributed machine learning, which enables clients to collaboratively learn a global model without sharing clients' data. Recently, many strategies have been proposed to improve the generality of the global model and thus improve FL effect. However, existing strategies either ignore the fairness among clients or sacrifice performance for fairness. They cannot ensure that the gap among clients is as small as possible without sacrificing federated performance. To address this issue, we propose ParetoFed, , a new local information aggregation method dedicated to obtaining better federated performance with smaller gap among clients. Specifically, we propose to use multi-objective hyperparameter optimization (HPO) algorithm to gain global models that are both fair and effective. Then, we send Pareto Optimal global models to each client, allowing them to choose the most suitable one as the base to optimize their local model. ParetoFed not only make the global models more fair but also make the selection of local models more personalized, which can further improve the federated performance. Extensive experiments show that ParetoFed outperforms existing FL methods in terms of fairness, and even achieves better federated performance, which demonstrates the significance of our method.
Keyword:
Fair federated learning
hyperparameter optimization
multi-objective optimization

期刊

ACM Transactions on Knowledge Discovery from Data 封面图
ACM Transactions on Knowledge Discovery from Data
IF:
4.8
论文数:
1.3K
被引数:
4.4K

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
引用论文

引用论文

Weekly cisplatin and radical radiation therapy for advanced, recurrent, and poor prognosis cervical carcinoma
err1993-06-01
err0
errOAAI
errJohn Malfetano; Daniel Kredentser; Mary Cunningham; Dennis Kotlove; Leena Weiss; Henry Keys
err分享
err收藏
Interactive Exploration of Design Trade-Offs设计权衡的交互式探索
err2018-07-30
err29
errOAAI
errSchulz, Adriana; Wang, Harrison; Grinspun, Eitan; Solomon, Justin; Matusik, Wojciech
err分享
err收藏
学者 查看更多内容