arrow
Return

A Communication-Efficient Local Differentially Private Algorithm in Federated Optimization

delete2023-01-01
delete1
delete
OA
AI
S
Syed Eqbal Alam *
D
Dhirendra Shukla
S
Shrisha Rao
DOI:10.1109/ACCESS.2023.3283503delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Federated optimization, wherein several agents in a network collaborate with a central server to achieve optimal social cost over the network with no requirement for exchanging information among agents, has attracted significant interest from the research community. In this context, agents demand resources based on their local computation. Due to the exchange of optimization parameters such as states, constraints, or objective functions with a central server, an adversary may infer sensitive information of agents. We develop a differentially-private additive-increase and multiplicative-decrease algorithm to allocate multiple divisible shared heterogeneous resources to agents in a network. The developed algorithm provides a differential privacy guarantee to each agent in the network. The algorithm does not require inter-agent communication, and the agents do not need to share their cost function or their derivatives with other agents or a central server; however, they share their allocation states with a central server that keeps track of the aggregate consumption of resources. The algorithm incurs very little communication overhead; for m heterogeneous resources in the system, the asymptotic upper bound on the communication complexity isO(m) bits at a time step. Furthermore, if the algorithm converges in K time steps, then the upper bound communication complexity will be O(mK) bits. The algorithm can find applications in several areas, including smart cities, smart energy systems, resource management in the sixth generation (6G) wireless networks with privacy guarantees, etc. We present experimental results to check the efficacy of the algorithm. Furthermore, we present empirical analyses for the trade-off between privacy and algorithm efficiency.
Keywords:
Differential privacy
Resource management
Servers
Privacy
Cost function
Costs
Complexity theory
Additive increase multiplicative decrease algorithm
AIMD algorithm
differential privacy
federated optimization
multi-resource allocation
heterogeneous resources
multi-agent system
communication-efficient resource allocation
optimization and control

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
University of New Brunswick
Scholars:
4.0K
Papers: 4.2K
Citations: 6.3K
Cited Papers

Cited Papers

Mechanism of Action of the Novel Nickel(II) Complex in Simultaneous Reactivation of the Apoptotic Signaling Networks Against Human Colon Cancer Cells
err2016-01-28
err0
errOAAI
errNima Samie; Batoul Sadat Haerian; Sekaran Muniandy; Anita Marlina; M. S. Kanthimathi; Norbani B. Abdullah; Gholamreza Ahmadian; Raja E. R. Aziddin
errShare
errSave
Foreign Direct Investment and Backward Spillovers in the Western Balkans
err2022-05-03
err0
errOAAI
errBesnik Krasniqi; Jasmina Ahmetbasić; Will Bartlett
errShare
errSave
The future of digital health with federated learning
err2020-09-14
err1.0K
errOAAI
errRieke, Nicola; Hancox, Jonny; Li, Wenqi; Milletari, Fausto; Roth, Holger R.; Albarqouni, Shadi; Bakas, Spyridon; Galtier, Mathieu N.; Landman, Bennett A.; Maier-Hein, Klaus; Ourselin, Sebastien; Sheller, Micah; Summers, Ronald M.; Trask, Andrew; Xu, Daguang; Baust, Maximilian; Cardoso, M. Jorge
errShare
errSave
Federated Learning for 6G: Applications, Challenges, and Opportunities
err2022-01-01
err96
errOAAI
errYang, Zhaohui; Chen, Mingzhe; Wong, Kai-Kit; Poor, H. Vincent; Cui, Shuguang
errShare
errSave
Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
err2020-09-01
err1.0K
errOAAI
errSattler, Felix; Wiedemann, Simon; Mueller, Klaus-Robert; Samek, Wojciech
errShare
errSave
researcher View more