.png){kind=icon}
.png){kind=icon}
Return
Dualityfree Methods for Stochastic Composition Optimization
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2018.2866699.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
In this paper, we consider the composition optimization with two expected-value functions in the form of (1/n) Sigma(n)(i=1) F-i ((1/m) Sigma(m)(j=1) G(j) (x)) + R(x), which formulates many important problems in statistical learning and machine learning such as solving Bellman equations in reinforcement learning and nonlinear embedding. Full gradient- or classical stochastic gradient descent-based optimization algorithms are unsuitable or computationally expensive to solve this problem due to the inner expectation (1/m) Sigma(m)(j=1) G(j) (x). We propose a dualityfree-based stochastic composition method that combines the variance reduction methods to address the stochastic composition problem. We apply the stochastic variance reduction gradient-and stochastic average gradient algorithm-based methods to estimate the inner function and the dualityfree method to estimate the outer function. We prove the linear convergence rate not only for the convex composition problem but also for the case that the individual outer functions are nonconvex, while the objective function is strongly convex. We also provide the results of experiments that show the effectiveness of our proposed methods.
Keywords:
Dualityfree
stochastic average gradient algorithm
stochastic composition optimization
stochastic variance reduction gradient (SVRG)
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
8.9
Papers:
7.5K
Citations:
7.2W