arrow
Return

Federated Learning Meets Multi-Objective Optimization

delete2022-07-01
delete51
delete
OA
AI
Z
Zeou Hu *
K
Kiarash Shaloudegi
G
Guojun Zhang
DOI:10.1109/TNSE.2022.3169117delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Federated learning has emerged as a promising, massively distributed way to train a joint deep model over large amounts of edgedevices while keeping private user data strictly on device. In this work, motivated from ensuring fairness among users and robustness against malicious adversaries, we formulate federated learning as multi-objective optimization and propose a new algorithm FedMGDA+ that is guaranteed to converge to Pareto stationary solutions. FedMGDA+ is simple to implement, has fewer hyperparameters to tune, and refrains from sacrificing the performance of any participating user. We establish the convergence properties of FedMGDA+ and point out its connections to existing approaches. Extensive experiments on a variety of datasets confirm that FedMGDA+ compares favorably against state-of-the-art.
Keywords:
Optimization
Collaborative work
Servers
Robustness
Convergence
Machine learning algorithms
Arithmetic
Pareto optimization
Distributed algorithms
Federated learning
Edge computing
Machine learning
Neural networks

Journal

I
IEEE Transactions on Network Science and Engineering
IF:
7.9
Papers:
2.6K
Citations:
10.0K

Organization

U
University of Waterloo
Scholars:
2.2W
Papers: 2.3W
Citations: 3.3W
Cited Papers

Cited Papers

Federated Machine Learning: Concept and Applications
err2019-01-28
err5.5K
PREAI
errYang, Qiang; Liu, Yang; Chen, Tianjian; Tong, Yongxin
errShare
errSave
How high is a MoSe2 monolayer?
err2021-12-28
err0
PREAI
errMegan Cowie; Rikke Plougmann; Yacine Benkirane; Léonard Schué; Zeno Schumacher; Peter Grütter
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more