arrow
返回

Random Directions Stochastic Approximation With Deterministic Perturbations

delete2020-06-01
delete5
delete
OA
AI
L
L. A. Prashanth *
S
Shalabh Bhatnagar
N
Nirav Bhavsar
M
Michael C. Fu
S
Steven I. Marcus
DOI:10.1109/TAC.2019.2930821delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We introduce deterministic perturbation (DP) schemes for the recently proposed random directions stochastic approximation, and propose new first-order and second-order algorithms. In the latter case, these are the first second-order algorithms to incorporate DPs. We show that the gradient and/or Hessian estimates in the resulting algorithms with DPs are asymptotically unbiased, so that the algorithms are provably convergent. Furthermore, we derive convergence rates to establish the superiority of the first-order and second-order algorithms, for the special case of a convex and quadratic optimization problem, respectively. Numerical experiments are used to validate the theoretical results.
Keyword:
Perturbation methods
Noise measurement
Signal processing algorithms
Linear programming
Convergence
Approximation algorithms
Optimization
Random directions stochastic approximation (RDSA)
simultaneous perturbation stochastic approximation (SPSA)
stochastic approximation
stochastic optimization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Automatic Control 封面图
IEEE Transactions on Automatic Control
IF:
7
论文数:
1.3W
被引数:
6.7W

机构

B
bosch
学者数:
2.4K
论文数: 1.7K
被引数: 3
I
indian institute of technology (iit) - madras
学者数:
5.1K
论文数: 5.2K
被引数: 1
I
indian institute of technology system (iit system)
学者数:
9.5W
论文数: 9.9W
被引数: 93
I
indian institute of science (iisc) - bangalore
学者数:
1.4W
论文数: 1.4W
被引数: 11
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Facile synthesis and high-frequency performance of CoFe2O4 nanocubes with different size
err2018-04-01
err0
PREAI
errNingning Song; Shangzhi Gu; Qiong Wu; Chenglin Li; Jun Zhou; Panpan Zhang; Wei Wang; Ming Yue
err分享
err收藏
Crack growth behavior of ferritic steel for USC boilers in pressurized superheated steam
err2014-01-02
err0
PREAI
errMasahiro Inuil; Yutaka Watanabe; Tatsuo Kondo; Koshi Suzuki; Kimio Kano
err分享
err收藏
学者 查看更多内容