返回
Random Directions Stochastic Approximation With Deterministic Perturbations
DOI:10.1109/TAC.2019.2930821.png)
摘要
En 中文
We introduce deterministic perturbation (DP) schemes for the recently proposed random directions stochastic approximation, and propose new first-order and second-order algorithms. In the latter case, these are the first second-order algorithms to incorporate DPs. We show that the gradient and/or Hessian estimates in the resulting algorithms with DPs are asymptotically unbiased, so that the algorithms are provably convergent. Furthermore, we derive convergence rates to establish the superiority of the first-order and second-order algorithms, for the special case of a convex and quadratic optimization problem, respectively. Numerical experiments are used to validate the theoretical results.
Keyword:
Perturbation methods
Noise measurement
Signal processing algorithms
Linear programming
Convergence
Approximation algorithms
Optimization
Random directions stochastic approximation (RDSA)
simultaneous perturbation stochastic approximation (SPSA)
stochastic approximation
stochastic optimization
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7
论文数:
1.3W
被引数:
6.7W
机构
引用论文
Fast quantification of fluoroquinolones in environmental water samples using molecularly imprinted polymers coupled with internal extractive electrospray ionization mass spectrometry
RSC Advances
IF0
Assessment of the effects of metribuzin, glyphosate, and their mixtures on the metabolism of the model plant Lemna minor L. applying metabolomics
Chemosphere
IF0

