arrow
Return

Adaptive Stochastic Optimization: A Framework for Analyzing Stochastic Optimization Algorithms

delete2020-09-01
delete16
PRE
AI
F
Frank E. Curtis *
K
Katya Scheinberg
DOI:10.1109/MSP.2020.3003539delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Optimization lies at the heart of machine learning (ML) and signal processing (SP). Contemporary approaches based on the stochastic gradient (SG) method are nonadaptive in the sense that their implementation employs prescribed parameter values that need to be tuned for each application. This article summarizes recent research and motivates future work on adaptive stochastic optimization methods, which have the potential to offer significant computational savings when training largescale systems.
Keywords:
Stochastic processes
Optimization
Signal processing algorithms
Adaptation models
Convergence
Testing
Tuning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

L
Lehigh University
Scholars:
4.8K
Papers: 5.1K
Citations: 6.3K
Cited Papers

Cited Papers

Decision Analysis of Peripheral Blood versus Bone Marrow Hematopoietic Stem Cells for Allogeneic Hematopoietic Cell Transplantation
err2009-11-01
err0
errOAAI
errJoseph Pidala; Claudio Anasetti; Mohamed A. Kharfan-Dabaja; Corey Cutler; Andy Sheldon; Benjamin Djulbegovic
errShare
errSave
Gene copy number for epidermal growth factor receptor (EGFR) and clinical response to antiEGFR treatment in colorectal cancer: a cohort study
err2005-05-01
err0
PREAI
errMauro Moroni; Silvio Veronese; Silvia Benvenuti; Giovanna Marrapese; Andrea Sartore-Bianchi; Federica Di Nicolantonio; Marcello Gambacorta; Salvatore Siena; Alberto Bardelli
errShare
errSave
An Open-Label Investigation of the Pharmacokinetic Profiles of Lisdexamfetamine Dimesylate and Venlafaxine Extended-Release, Administered Alone and in Combination, in Healthy Adults
err2013-03-20
err0
errOAAI
errJames Ermer; Mary B. Haffey; Cynthia Richards; Kenneth Lasseter; Benno Roesch; Jaideep Purkayastha; Mary Corcoran; Bree Harlin; Patrick Martin
errShare
errSave
inheritance and social organization among family farmers
err2009-10-28
err0
PREAI
errSUSAN CAROL ROGERS; SONYA SALAMON
errShare
errSave
researcher View more