arrow
返回

Online composite optimization with time-varying regularizers

delete2024-07-01
delete1
PRE
AI
R
R.Z. Hou
李
李修贤 (Xiuxian Li) *
Y
Yang Shi
DOI:10.1016/j.jfranklin.2024.106884delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper investigates online composite optimization in dynamic environments, where each objective or loss function contains a time-varying nondifferentiable regularizer. To resolve it, an online proximal gradient algorithm is studied for two distinct scenarios, including convex and strongly convex objectives without the smooth condition. In both scenarios, unlike most of works, an extended version of the conventional path variation is employed to bound the considered performance metric, i.e., dynamic regret. In the convex scenario, a bound O(root T1-beta D-beta(T) + T) is obtained which is comparable to the best-known result, where D-beta(T) is the extended path variation with beta is an element of [0, 1) and T being the total number of rounds. In strongly convex case, a bound O(log T(1 + T-beta D beta(T))) on the dynamic regret is established. In the end, numerical examples are presented to support the theoretical findings.
Keyword:
Online optimization
Composite optimization
Convex optimization
Dynamic regret
Dynamic environments

期刊

J
Journal of the Franklin Institute-Engineering and Applied Mathematics
IF:
3.7
论文数:
6.4K
被引数:
1.5W

机构

T
tongji university
学者数:
7.9W
论文数: 6.0W
被引数: 98
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Distributed Mirror Descent for Online Composite Optimization
err2021-02-01
err60
errOAAI
errYuan, Deming; Hong, Yiguang; Ho, Daniel W. C.; Xu, Shengyuan
err分享
err收藏
err分享
err收藏
Learning in Nonstationary Environments: A Survey
err2015-11-01
err569
errOAAI
errDitzler, Gregory; Roveri, Manuel; Alippi, Cesare; Polikar, Robi
err分享
err收藏
学者 查看更多内容