arrow
返回

AN EFFICIENT AND ROBUST SCALAR AUXIALIARY VARIABLE BASED ALGORITHM FOR DISCRETE GRADIENT SYSTEMS ARISING FROM OPTIMIZATIONS

delete2023-09-21
delete2
PRE
AI
X
Xinyu Liu *
J
Jie Shen
X
Xiangxiong Zhang
DOI:10.1137/23M1545744delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We propose in this paper a new minimization algorithm based on a slightly modified version of the scalar auxialiary variable (SAV) approach coupled with a relaxation step and an adaptive strategy. It enjoys several distinct advantages over popular gradient based methods: (i) it is unconditionally energy diminishing with a modified energy which is intrinsically related to the original energy, and thus no parameter tuning is needed for stability; (ii) it allows the use of large step-sizes which can effectively accelerate the convergence rate. We also present a convergence analysis for some SAV based algorithms, which include our new algorithm without the relaxation step as a special case. We apply our new algorithm to several illustrative and benchmark problems and compare its performance with several popular gradient based methods. The numerical results indicate that the new algorithm is very robust, and its adaptive version usually converges significantly faster than those popular gradient decent based methods.
Keyword:
discrete gradient system
optimization
scalar auxiliary variable
adaptive
stability
convergence

期刊

SIAM Journal on Scientific Computing 封面图
SIAM Journal on Scientific Computing
IF:
2.6
论文数:
5.1K
被引数:
1.8W

机构

Purdue University System 封面图
Purdue University System
学者数:
4.0W
论文数: 3.6W
被引数: 66
P
Purdue University
学者数:
2.7W
论文数: 2.1W
被引数: 147
引用论文

引用论文

err分享
err收藏
Safety and tolerability of inhaled hypertonic saline in young children with cystic fibrosis
err2008-09-30
err0
PREAI
errElisabeth P. Dellon; Scott H. Donaldson; Robin Johnson; Stephanie D. Davis
err分享
err收藏
err分享
err收藏
Exogenous cathepsin G upregulates cell surface MHC class I molecules on immune and glioblastoma cells
err2016-10-28
err0
errOAAI
errMadleen Giese; Nadine Turiello; Nicole Molenda; David Palesch; Annika Meid; Roman Schroeder; Paola Basilico; Charaf Benarafa; Marc-Eric Halatsch; Michal Zimecki; Mike-Andrew Westhoff; Christian Rainer Wirtz; Timo Burster
err分享
err收藏
学者 查看更多内容