arrow
返回

Optimizing Top-k Multiclass SVM via Semismooth Newton Algorithm

delete2018-12-01
delete4
PRE
AI
D
Dejun Chu
R
Rui Lü
J
Jin Li
X
Xintong Yu
C
Changshui Zhang *
Q
Qing Tao
DOI:10.1109/TNNLS.2018.2826039delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Top-k performance has recently received increasing attention in large data categories. Advances, like a top-k multiclass support vector machine (SVM), have consistently improved the top-k accuracy. However, the key ingredient in the state-of-the-art optimization scheme based upon stochastic dual coordinate ascent relies on the sorting method, which yields O(d log d) complexity. In this paper, we leverage the semismooth-ness of the problem and propose an optimized top-k multiclass SVM algorithm, which employs semismooth Newton algorithm for the key building block to improve the training speed. Our method enjoys a local superlinear convergence rate in theory. In practice, experimental results confirm the validity. Our algorithm is four times faster than the existing method in large synthetic problems; Moreover, on real-world data sets it also shows significant improvement in training time.
Keyword:
Multiclass support vector machine (SVM)
root finding
semismooth Newton method
stochastic dual coordinate ascent (SDCA) optimization
top-k error
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Post-traumatic stress disorder: emerging concepts of pharmacotherapy
err2009-05-20
err0
errOAAI
errDewleen G Baker; Caroline M Nievergelt; Victoria B Risbrough
err分享
err收藏
err分享
err收藏
Ingestion of corrosive acids
err1989-09-01
err0
PREAI
errShowkat Ali Zargar; Rakesh Kochhar; Birender Nagi; Saroj Mehta; Satish Kumar Mehta
err分享
err收藏
Temporal and Spatial Relationship by Environmental Factors as an Effective Prediction for Occurrence of Dengue Fever: Case Study
err2013-01-01
err0
PREAI
errMarco Aurélio Pereira Horta; Aldo Pacheco Ferreira; Cristina Maria Souza Catita; Fabricio Thomaz de Oliveira
err分享
err收藏
学者 查看更多内容