Closed-Form Gaussian Spread Estimation for Small and Large Support Vector Classification

Diego Isla-Cernadas

doi:10.1109/TNNLS.2024.3377370

Closed-Form Gaussian Spread Estimation for Small and Large Support Vector Classification

2025-03-01

0

OA

AI

D

Diego Isla-Cernadas

M

Manuel Fernández-Delgado *

DOI：10.1109/TNNLS.2024.3377370

原文链接

原文求助

摘要

En 中文

The support vector machine (SVM) with Gaussian kernel often achieves state-of-the-art performance in classification problems, but requires the tuning of the kernel spread. Most optimization methods for spread tuning require training, being slow and not suited for large-scale datasets. We formulate an analytic expression to calculate, directly from data without iterative search, the spread minimizing the difference between Gaussian and ideal kernel matrices. The proposed direct gamma tuning (DGT) equals the performance of and is one to two orders of magnitude faster than the state-of-the art approaches on 30 small datasets. Combined with random sampling of training patterns, it also runs on large classification problems. Our method is very efficient in experiments with 20 large datasets up to 31 million of patterns, it is faster and performs significantly better than linear SVM, and it is also faster than iterative minimization.

Keyword:

Classification

efficient computing

large-scale datasets

model selection

radial basis kernel

support vector machine (SVM)

Closed-Form Gaussian Spread Estimation for Small and Large Support Vector Classification

摘要

期刊

机构

引用论文