arrow
Return

Accelerating Sequential Minimal Optimization via Stochastic Subgradient Descent

delete2021-04-01
delete11
PRE
AI
顾彬 cover
顾彬 (Bin Gu) *
Y
Yingying Shan
X
Xin Quan
G
Guansheng Zheng *
DOI:10.1109/TCYB.2019.2893289delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Sequential minimal optimization (SMO) is one of the most popular methods for solving a variety of support vector machines (SVMs). The shrinking and caching techniques are commonly used to accelerate SMO. An interesting phenomenon of SMO is that most of the computational time is wasted on the first half of iterations for building a good solution closing to the optimal. However, as we all know, the stochastic subgradient descent (SSGD) method is extremely fast for building a good solution. In this paper, we propose a generalized framework of accelerating SMO through SSGD for a variety of SVMs of binary classification, regression, ordinal regression, and so on. We also provide a deep insight about why SSGD can accelerate SMO. Experimental results on a variety of datasets and learning applications confirm that our method can effectively speed up SMO.
Keywords:
Acceleration
Kernel
Time complexity
Support vector machines
Buildings
Training
Static VAr compensators
Decomposition method
sequential minimal optimization (SMO)
stochastic gradient descent (SGD)
support vector machines (SVMs)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

No organization information available
Cited Papers

Cited Papers

Incremental learning for ν-Support Vector Regression
err2015-07-01
err432
PREAI
errGu, Bin; Sheng, Victor S.; Wang, Zhijie; Ho, Derek; Osman, Said; Li, Shuo
errShare
errSave
Ordinal Regression Methods: Survey and Experimental Study
err2016-01-01
err336
errOAAI
errAntonio Gutierrez, Pedro; Perez-Ortiz, Maria; Sanchez-Monedero, Javier; Fernandez-Navarro, Francisco; Hervas-Martinez, Cesar
errShare
errSave
errShare
errSave
Effect of Chemical Treatments on the Physical Properties of Non-woven Jute/PLA Biocomposites
err2015-09-17
err0
errOAAI
errG. M. Arifuzzaman Khan; Hamid Shaikh; M. Shamsul Alam; Md. Abdul Gafur; Saeed M. Al-Zahrani
errShare
errSave
ASRM müllerian anomalies classification 2021
err2021-11-01
err0
errOAAI
errSamantha M. Pfeifer; Marjan Attaran; Jessica Goldstein; Steven R. Lindheim; John C. Petrozza; Beth W. Rackow; Evan Siegelman; Robert Troiano; Thomas Winter; Andrea Zuckerman; Sarah D. Ramaiah
errShare
errSave
researcher View more