arrow
返回

Accelerating Sequential Minimal Optimization via Stochastic Subgradient Descent

delete2021-04-01
delete11
PRE
AI
顾彬 封面图
顾彬 (Bin Gu) *
Y
Yingying Shan
X
Xin Quan
G
Guansheng Zheng *
DOI:10.1109/TCYB.2019.2893289delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Sequential minimal optimization (SMO) is one of the most popular methods for solving a variety of support vector machines (SVMs). The shrinking and caching techniques are commonly used to accelerate SMO. An interesting phenomenon of SMO is that most of the computational time is wasted on the first half of iterations for building a good solution closing to the optimal. However, as we all know, the stochastic subgradient descent (SSGD) method is extremely fast for building a good solution. In this paper, we propose a generalized framework of accelerating SMO through SSGD for a variety of SVMs of binary classification, regression, ordinal regression, and so on. We also provide a deep insight about why SSGD can accelerate SMO. Experimental results on a variety of datasets and learning applications confirm that our method can effectively speed up SMO.
Keyword:
Acceleration
Kernel
Time complexity
Support vector machines
Buildings
Training
Static VAr compensators
Decomposition method
sequential minimal optimization (SMO)
stochastic gradient descent (SGD)
support vector machines (SVMs)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

暂无机构信息
引用论文

引用论文

Incremental learning for ν-Support Vector RegressionΝ-支持向量回归的增量学习
err2015-07-01
err432
PREAI
errGu, Bin; Sheng, Victor S.; Wang, Zhijie; Ho, Derek; Osman, Said; Li, Shuo
err分享
err收藏
Ordinal Regression Methods: Survey and Experimental Study序数回归方法: 调查与实验研究
err2016-01-01
err336
errOAAI
errAntonio Gutierrez, Pedro; Perez-Ortiz, Maria; Sanchez-Monedero, Javier; Fernandez-Navarro, Francisco; Hervas-Martinez, Cesar
err分享
err收藏
err分享
err收藏
err分享
err收藏
ASRM müllerian anomalies classification 2021
err2021-11-01
err0
errOAAI
errSamantha M. Pfeifer; Marjan Attaran; Jessica Goldstein; Steven R. Lindheim; John C. Petrozza; Beth W. Rackow; Evan Siegelman; Robert Troiano; Thomas Winter; Andrea Zuckerman; Sarah D. Ramaiah
err分享
err收藏
学者 查看更多内容