arrow
Return

A Stochastic Approximation Framework for a Class of Randomized Optimization Algorithms

delete2012-01-01
delete37
PRE
AI
J
Jiaqiao Hu *
胡平 (Ping Hu)
H
Hyeong Soo Chang
DOI:10.1109/TAC.2011.2158128delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We study a class of random sampling-based algorithms for solving general non-differentiable optimization problems. These are iterative approaches that are based on sampling from and updating an underlying distribution function over the set of feasible solutions. In particular, we propose a novel and systematic framework to investigate the convergence and asymptotic convergence rates of these algorithms by exploiting their connections to the well-known stochastic approximation ( SA) method. Such an SA framework unifies our understanding of these randomized algorithms and provides new insight into their design and implementation issues. Our preliminary numerical experiments indicate that new implementations of these algorithms based on the proposed framework may lead to improved performance over existing procedures.
Keywords:
Algorithm design and analysis
optimization
stochastic approximation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Automatic Control cover
IEEE Transactions on Automatic Control
IF:
7
Papers:
1.3W
Citations:
6.7W

Organization

S
stony brook university
Scholars:
1.3W
Papers: 1.0W
Citations: 20
S
state university of new york (suny) system
Scholars:
6.5W
Papers: 5.8W
Citations: 65