arrow
Return

An Adaptive Primal-Dual Subgradient Algorithm for Online Distributed Constrained Optimization

delete2018-11-01
delete61
PRE
AI
D
Deming Yuan *
D
Daniel W. C. Ho
G
Guo‐Ping Jiang
DOI:10.1109/TCYB.2017.2755720delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we consider the problem of solving distributed constrained optimization over a multiagent network that consists of multiple interacting nodes in online setting, where the objective functions of nodes are time-varying and the constraint set is characterized by an inequality. Through introducing a regularized convex-concave function, we present a consensus-based adaptive primal-dual subgradient algorithm that removes the need for knowing the total number of iterations T in advance. We show that the proposed algorithm attains an O(T1/2+c) [where c is an element of (0, 1/ 2)] regret bound and an O(T1-c/2) bound on the violation of constraints; in addition, we show an improvement to an O(T-c) regret bound when the objective functions are strongly convex. The proposed algorithm allows a novel trade-offs between the regret and the violation of constraints. Finally, a numerical example is provided to illustrate the effectiveness of the algorithm.
Keywords:
Adaptive regularization
distributed optimization
online convex optimization
regret bound
violation of constraints

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
Cited Papers

Cited Papers

Cooperative Distributed Optimization in Multiagent Networks With Delays
err2015-02-01
err131
PREAI
errWang, Huiwei; Liao, Xiaofeng; Huang, Tingwen; Li, Chaojie
errShare
errSave
Gossip Algorithms for Convex Consensus Optimization Over Networks
err2011-12-01
err85
errOAAI
errLu, Jie; Tang, Choon Yik; Regier, Paul R.; Bow, Travis D.
errShare
errSave
Fast Distributed Gradient Methods
err2014-05-01
err463
errOAAI
errJakovetic, Dusan; Xavier, Joao; Moura, Jose M. F.
errShare
errSave
Selective observation of the two oxygen atoms at different sites in the carboxyl group (–COOH) of liquid acetic acid
err2009-01-01
err0
PREAI
errTakashi Tokushima; Yuka Horikawa; Yoshihisa Harada; Osamu Takahashi; Atsunari Hiraya; Shik Shin
errShare
errSave
researcher View more