arrow
返回

Inexact proximal gradient algorithm with random reshuffling for nonsmooth optimization

delete2024-11-19
delete0
PRE
AI
X
Xia Jiang
Y
Yanyan Fang
X
Xianlin Zeng *
孙
孙健 (Jian Sun)
陈
陈杰 (Jie Chen)
DOI:10.1007/s11432-023-4095-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Proximal gradient algorithms are popularly implemented to achieve convex optimization with nonsmooth regularization. Obtaining the exact solution of the proximal operator for nonsmooth regularization is challenging because errors exist in the computation of the gradient; consequently, the design and application of inexact proximal gradient algorithms have attracted considerable attention from researchers. This paper proposes computationally efficient basic and inexact proximal gradient descent algorithms with random reshuffling. The proposed stochastic algorithms take randomly reshuffled data to perform successive gradient descents and implement only one proximal operator after all data pass through. We prove the convergence results of the proposed proximal gradient algorithms under the sampling-without-replacement reshuffling scheme. When computational errors exist in gradients and proximal operations, the proposed inexact proximal gradient algorithms can converge to an optimal solution neighborhood. Finally, we apply the proposed algorithms to compressed sensing and compare their efficiency with some popular algorithms.
Keyword:
proximal operator
random reshuffling
inexact computation
compressed sensing
nonsmooth optimization

期刊

Science China Information Sciences 封面图
Science China Information Sciences
IF:
7.6
论文数:
4.9K
被引数:
8.9K

机构

B
beijing institute of technology
学者数:
5.5W
论文数: 4.0W
被引数: 63
引用论文

引用论文

err分享
err收藏
Movement, Stillness
err2021-07-21
err0
PREAI
errRobert Desjarlais
err分享
err收藏
err分享
err收藏
err分享
err收藏
Large-amplitude magnetic pulses downstream of the Jovian bow shock: Ulysses observations
err1993-11-01
err0
PREAI
errBruce T. Tsurutani; John K. Arballo; Edward J. Smith; David Southwood; Andre Balogh
err分享
err收藏
学者 查看更多内容