.png){kind=icon}
.png){kind=icon}
Return
Si-level stochastic gradient for large scale support vector machine
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2014.11.025.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We propose a new bi-level stochastic optimization algorithm for training large scale support vector machine (SVM) with automatic selection of the C hyperparameter. We show that in the proposed bi-level formulation, the variation of the inner objective with respect to the outer variable can be nicely expressed. Gradient estimates are computed for both inner and outer objectives in order to perform stochastic moves with low complexity. Extension to nonlinear SVM is also proposed. We further discuss the possibility to integrate the technique within an automatic k-fold cross validation framework. Preliminary results on several datasets show that the method is finding the optimum hyperplane while adjusting the penalty parameter with significant computational time savings when compared to the classic cross validation procedure. (C) 2014 Elsevier B.V. All rights reserved.
Keywords:
Support vector machine
Model selection
Stochastic gradient
Multi-level optimization
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.