arrow
Return

Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and Applications

delete2023-01-01
delete2
delete
OA
AI
E
Ege C. Kaya
M
Mehmet Berk Sahin
A
Abolfazl Hashemi *
DOI:10.1109/ACCESS.2023.3284891delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper focuses on a multi-agent zeroth-order online optimization problem in a federated learning setting for target tracking. The agents only sense their current distances to their targets and aim to maintain a minimum safe distance from each other to prevent collisions. The coordination among the agents and dissemination of collision-prevention information is managed by a central server using the federated learning paradigm. The proposed formulation leads to an instance of distributed online nonconvex optimization problem that is solved via a group of communication-constrained agents. To deal with the communication limitations of the agents, an error feedback-based compression scheme is utilized for agent-to-server communication. The proposed algorithm is analyzed theoretically for the general class of distributed online nonconvex optimization problems. We provide non-asymptotic convergence rates that show the dominant term is independent of the characteristics of the compression scheme. Our theoretical results feature a new approach that employs significantly more relaxed assumptions in comparison to standard literature. The performance of the proposed solution is further analyzed numerically in terms of tracking errors and collisions between agents in two relevant applications.
Keywords:
Communication efficiency
compression schemes
federated learning
online optimization
zeroth-order optimization

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

Purdue University System cover
Purdue University System
Scholars:
3.9W
Papers: 3.6W
Citations: 66
Cited Papers

Cited Papers

Effect of various flavonoids on lysosomes subjected to an oxidative or an osmotic stress
err1992-10-01
err0
PREAI
errThierry Decharneux; Franz Dubois; Christophe Beauloye; Simone Wattiaux De Coninck; Robert Wattiaux
errShare
errSave
On the Benefits of Multiple Gossip Steps in Communication-Constrained Decentralized Federated Learning
err2022-01-01
err19
errOAAI
errHashemi, Abolfazl; Acharya, Anish; Das, Rudrajit; Vikalo, Haris; Sanghavi, Sujay; Dhillon, Inderjit
errShare
errSave
errShare
errSave
researcher View more