.png){kind=icon}
返回
A RELAXED VECTOR AUXILIARY VARIABLE ALGORITHM FOR UNCONSTRAINED OPTIMIZATION PROBLEMS
.png){kind=icon}
PRE
AI
DOI：10.1137/23M1611087.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We present a novel optimization algorithm, a relaxed vector auxiliary variable (RVAV), that satisfies an unconditional energy dissipation law and exhibits improved alignment between the modified and the original energy. Our algorithm features rigorous proofs of linear convergence in the convex setting. Furthermore, we present a simple accelerated algorithm that improves the linear convergence rate to superlinear in the univariate case. We also propose an adaptive version of RVAV with Steffensen step size. We validate the robustness and fast convergence of our algorithm through ample numerical experiments.
Keyword:
Key words. optimization
gradient descent
machine learning
SAV
adaptive learning rate
期刊
IF:
2.6
论文数:
5.1K
被引数:
1.8W
机构
引用论文
.png){kind=icon}
Improving the accuracy and consistency of the scalar auxiliary variable (SAV) method with relaxation
OAAI
OAAI分享收藏Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations物理信息神经网络: 一种用于解决涉及非线性偏微分方程的正反问题的深度学习框架OAAI
OAAI分享收藏Examination on High-Q NMR Transmit/Receiver Pickup Coils Made by YBa2Cu3O7-δ Thin Films基于YBa2Cu3O7-δ薄膜制备的高Q值NMR收发拾波线圈的检测
PREAI
分享收藏
查看更多内容