arrow
Return

Distributed Nonconvex Optimization: Gradient-Free Iterations and ε-Globally Optimal Solution

delete2024-12-01
delete0
delete
OA
AI
Z
Zhiyu He
J
Jianping He *
陈彩莲 (Cailian Chen)
关新平 (Xinping Guan)
DOI:10.1109/TCNS.2024.3395723delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Distributed optimization utilizes local computation and communication to realize a global aim of optimizing the sum of local objective functions. This article addresses a class of constrained distributed nonconvex optimization problems involving univariate objectives, aiming to achieve global optimization without requiring local evaluations of gradients at every iteration. We propose a novel algorithm named Chebyshev-proxy-and-consensus-based algorithm, exploiting the notion of combining Chebyshev polynomial approximation, average consensus, and polynomial optimization. The proposed algorithm is able to obtain epsilon-globally optimal solutions for any arbitrarily small given accuracy epsilon, efficient in both zeroth-order queries (i.e., evaluations of function values) and interagent communication, and distributed terminable when the specified precision requirement is met. The key insight is to use polynomial approximations to substitute for general local objectives, distribute these approximations via average consensus, and solve an easier approximate version of the original problem. Due to the nice analytic properties of polynomials, this approximation not only facilitates efficient global optimization, but also allows the design of gradient-free iterations to reduce cumulative costs of queries and achieve geometric convergence for solving nonconvex problems. We provide a comprehensive analysis of the accuracy and complexities of the proposed algorithm.
Keywords:
Optimization
Approximation algorithms
Convergence
Polynomials
Chebyshev approximation
Linear programming
Control systems
Chebyshev polynomial approximation
consensus
distributed optimization
nonconvex optimization

Journal

IEEE Transactions on Control of Network Systems cover
IEEE Transactions on Control of Network Systems
IF:
5
Papers:
1.6K
Citations:
5.8K

Organization

S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159