arrow
Return

Optimizing resources in model selection for support vector machine

delete2007-03-01
delete38
PRE
AI
M
Mohamed Cheriet
DOI:10.1016/j.patcog.2006.06.012delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Tuning support vector machine (SVM) hyperparameters is an important step in achieving a high-performance learning machine. It is usually done by minimizing an estimate of generalization error based on the bounds of the leave-one-out (LOO) such as radius-margin bound and on the performance measures such as generalized approximate cross-validation (GACV), empirical error, etc. These usual automatic methods used to tune the hyperparameters require an inversion of the Gram-Schmidt matrix or a resolution of an extra-quadratic programming problem. In the case of a large data set these methods require the addition of huge amounts of memory and a long CPU time to the already significant resources used in SVM training. In this paper, we propose a fast method based on an approximation of the gradient of the empirical error, along with incremental learning, which reduces the resources required both in terms of processing time and of storage space. We tested our method on several benchmarks, which produced promising results confirming our approach. Furthermore, it is worth noting that the gain time increases when the data set is large. (c) 2006 Pattern Recognition Society. Published by Elsevier Ltd. All rights reserved.
Keywords:
model selection
SVM
kernel
hyperparameters
optimizing time
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

No organization information available
Cited Papers

Cited Papers

Browplasty as an adjunct to rhinoplasty
err2006-07-18
err0
PREAI
errRichard C. Webster; Terence M. Davidson; Richard C. Smith
errShare
errSave
Monitoring of the Training Load and Well-Being of Elite Rhythmic Gymnastics Athletes in 25 Weeks: A Comparison between Starters and Reserves
err2022-11-28
err0
errOAAI
errIohanna Fernandes; João H. Gomes; Levy de Oliveira; Marcos Almeida; João G. Claudino; Camila Resende; Dermival R. Neto; Mónica Hontoria Galán; Paulo Márcio P. Oliveira; Felipe J. Aidar; Renata Mendes; Marzo E. Da Silva-Grigoletto
errShare
errSave
Choosing multiple parameters for support vector machines
err2002-01-01
err2.0K
errOAAI
errChapelle, O; Vapnik, V; Bousquet, O; Mukherjee, S
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
Soft margins for AdaBoost
err2001-01-01
err1.0K
errOAAI
errRätsch, G; Onoda, T; Müller, KR
errShare
errSave
Structure and transport properties of polymer inclusion membranes for Pb(II) separation
err2011-04-01
err0
PREAI
errAndrzej Oberta; Janusz Wasilewski; Romuald Wódzki
errShare
errSave
errShare
errSave
An integrated technique for assessing flow parameters through subsurface drainage module systems
err2020-04-01
err0
errOAAI
errA S Abdurrasheed; K W Yusof; H Takaijudin; E H H Al-Qadami; A A Ghani; M M Muhammad; A T Sholagberu; V Kumar; S M Patel
errShare
errSave
no more