arrow
Return

Sparse kernel SVMs via cutting-plane training

delete2009-07-23
delete97
PRE
AI
T
Thorsten Joachims
C
Chun-Nam Yu *
DOI:10.1007/s10994-009-5126-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We explore an algorithm for training SVMs with Kernels that can represent the learned rule using arbitrary basis vectors, not just the support vectors (SVs) from the training set. This results in two benefits. First, the added flexibility makes it possible to find sparser solutions of good quality, substantially speeding-up prediction. Second, the improved sparsity can also make training of Kernel SVMs more efficient, especially for high-dimensional and sparse data (e.g. text classification). This has the potential to make training of Kernel SVMs tractable for large training sets, where conventional methods scale quadratically due to the linear growth of the number of SVs. In addition to a theoretical analysis of the algorithm, we also present an empirical evaluation.
Keywords:
Support vector machines
Kernel methods
Sparse kernel methods
Cutting plane algorithm
Basis pursuit
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

C
Cornell University
Scholars:
6.3W
Papers: 5.4W
Citations: 10.9W