.png){kind=icon}
返回
Optimal random perturbations for stochastic approximation using a simultaneous perturbation gradient approximation
.png){kind=icon}
OA
AI
DOI：10.1109/9.720513.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The simultaneous perturbation stochastic approximation (SPSA) algorithm has recently attracted considerable attention for challenging optimization problems where it is difficult or impossible to obtain a direct gradient of the objective (say, loss) function. The approach is based on a highly efficient simultaneous perturbation approximation to the gradient based on loss function measurements. SPSA is based on picking a simultaneous perturbation (random) vector in a Monte Carlo fashion as part of generating the approximation to the gradient. This paper derives the optimal distribution for the Monte Carlo process. The objective is to minimize the mean square error of the estimate. The authors also consider maximization of the likelihood that the estimate be confined within a bounded symmetric region of the true parameter. The optimal distribution for the components of the simultaneous perturbation vector is found to be a symmetric Bernoulli in both cases. The authors end the paper with a numerical study related to the area of experiment design.
Keyword:
experiment design
optimal probability distribution
optimization
SPSA
stochastic approximation
期刊
IF:
7
论文数:
1.3W
被引数:
6.7W
机构
暂无机构信息
引用论文
New Chemically Amplified Positive Photoresist with Phenolic Resin Modified by GMA and BOC Protection.png)
PolymersOAAI
PolymersIF0
OAAI分享收藏
分享收藏分享收藏 没有更多内容
没有更多内容