Return
Adaptive Stochastic Optimization: A Framework for Analyzing Stochastic Optimization Algorithms
DOI:10.1109/MSP.2020.3003539.png)
Abstract
En 中文
Optimization lies at the heart of machine learning (ML) and signal processing (SP). Contemporary approaches based on the stochastic gradient (SG) method are nonadaptive in the sense that their implementation employs prescribed parameter values that need to be tuned for each application. This article summarizes recent research and motivates future work on adaptive stochastic optimization methods, which have the potential to offer significant computational savings when training largescale systems.
Keywords:
Stochastic processes
Optimization
Signal processing algorithms
Adaptation models
Convergence
Testing
Tuning
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
9.6
Papers:
1.1W
Citations:
1.7W

