返回
Optimizing Top-k Multiclass SVM via Semismooth Newton Algorithm
DOI:10.1109/TNNLS.2018.2826039.png)
摘要
En 中文
Top-k performance has recently received increasing attention in large data categories. Advances, like a top-k multiclass support vector machine (SVM), have consistently improved the top-k accuracy. However, the key ingredient in the state-of-the-art optimization scheme based upon stochastic dual coordinate ascent relies on the sorting method, which yields O(d log d) complexity. In this paper, we leverage the semismooth-ness of the problem and propose an optimized top-k multiclass SVM algorithm, which employs semismooth Newton algorithm for the key building block to improve the training speed. Our method enjoys a local superlinear convergence rate in theory. In practice, experimental results confirm the validity. Our algorithm is four times faster than the existing method in large synthetic problems; Moreover, on real-world data sets it also shows significant improvement in training time.
Keyword:
Multiclass support vector machine (SVM)
root finding
semismooth Newton method
stochastic dual coordinate ascent (SDCA) optimization
top-k error
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Dual coordinate descent methods for logistic regression and maximum entropy modelslogistic回归和最大熵模型的双坐标下降方法
MACHINE LEARNING
IF2.9
Integrated Optimization Design of Combined Cooling, Heating, and Power System Coupled with Solar and Biomass Energy
Energies
IF0

