arrow
Return

Distributed approximate Newton algorithms and weight design for constrained optimization

delete2019-11-01
delete29
delete
OA
AI
T
Tor Anderson *
C
Chin-Yao Chang
S
Sonia Martı́nez
DOI:10.1016/j.automatica.2019.108538delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Motivated by economic dispatch and linearly-constrained resource allocation problems, this paper proposes a class of novel DISTRIBUTED APPROX-NEWTON algorithms that approximate the standard Newton optimization method. We first develop the notion of an optimal edge weighting for the communication graph over which agents implement the second-order algorithm, and propose a convex approximation for the nonconvex weight design problem. We next build on the optimal weight design to develop a DISCRETE DISTRIBUTED APPROX-NEWTON algorithm which converges linearly to the optimal solution for economic dispatch problems with unknown cost functions and relaxed local box constraints. For the full box-constrained problem, we develop a CONTINUOUS DISTRIBUTED APPROX-NEWTON algorithm which is inspired by first-order saddle-point methods and rigorously prove its convergence to the primal and dual optimizers. A main property of each of these distributed algorithms is that they only require agents to exchange constant-size communication messages, which lends itself to scalable implementations. Simulations demonstrate that the DISTRIBUTED APPROX-NEWTON algorithms with our weight design have superior convergence properties compared to existing weighting strategies for first-order saddle-point and gradient descent methods. (C) 2019 Elsevier Ltd. All rights reserved.
Keywords:
Distributed optimization
Multi-agent systems
Resource allocation
Networked systems
Second-order methods
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Automatica cover
Automatica
IF:
5.9
Papers:
1.2W
Citations:
5.2W

Organization

University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
U
University of California San Diego
Scholars:
4.6W
Papers: 3.5W
Citations: 924