Adaptive stochastic approximation by the simultaneous perturbation method

James C. Spall

doi:10.1109/TAC.2000.880982

2000-10-01

330

PRE

James C. Spall *

DOI：10.1109/TAC.2000.880982

原文链接

原文求助

摘要

En 中文

Stochastic approximation (SA! has long been applied for problems of minimizing loss functions or root finding with noisy input information. As with all stochastic search algorithms, there are adjustable algorithm coefficients that must be specified, and that can have a profound effect on algorithm performance. It is known that choosing these coefficients according to an SA analog of the deterministic Newton-Raphson algorithm provides an optimal or near-optimal form of the algorithm. However, directly determining the required Hessian matrix (or Jacobian matrix for root finding) to achieve this algorithm form has often been difficult or impossible in practice, This paper presents a general adaptive SA algorithm that is based on a simple method for estimating the Hessian matrix, while concurrently estimating the primary parameters of interest. The approach applies in both the gradient-free optimization (Kiefer-Wolfowitz) and root-finding/stochastic gradient-based (Robbins-Monro) settings, and is based on the simultaneous perturbation (SP) idea introduced previously: The algorithm requires only a small number of loss function or gradient measurements per iteration-independent of the problem dimension-to adaptively estimate the Hessian and parameters of primary interest. Aside from introducing the adaptive SP approach, this paper presents practical implementation guidance, asymptotic theory, and a nontrivial numerical evaluation. Also included is a discussion and numerical analysis comparing the adaptive SP approach with the iterate-averaging approach to accelerated SA.

Keyword:

adaptive estimation

optimization

parameter estimation

root-finding

simultaneous perturbation stochastic approximation (SPSA)

stochastic approximation

AI总结

对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Automatic Control

IF:

论文数:

1.3W

被引数:

6.7W

机构

暂无机构信息

引用论文

Muscle swelling following blood flow‐restricted exercise does not differ between cuff widths in the proximal or distal portions of the upper leg

Clinical Physiology and Functional Imaging

IF0

2020-05-06

PREAI

Zachary W. Bell; Takashi Abe; Vickie Wong; Robert W. Spitz; Ricardo B. Viana; Raksha N. Chatakondi; Scott J. Dankel; Yujiro Yamada; Jeremy P. Loenneke

Effect of Calcium Silicate Hydrate Seeds on Hydration and Mechanical Properties of Cement

Journal of Wuhan University of Technology-Mater. Sci. Ed.

IF0

2021-01-24

PREAI

Yisa Wang; Linnü Lü; Yongjia He; Fazhou Wang; Shuguang Hu

Control of TH2 polarization by the chemokine monocyte chemoattractant protein-1

Nature

IF0

2000-03-01

PREAI

Long Gu; Susan Tseng; Renée M. Horner; Carmen Tam; Massimo Loda; Barrett J. Rollins