Sparse support vector regression based on orthogonal forward selection for the generalised kernel model

doi:10.1016/j.neucom.2005.12.129

Sparse support vector regression based on orthogonal forward selection for the generalised kernel model

2006-12-01

50

OA

AI

DOI：10.1016/j.neucom.2005.12.129

Original

Save

View PDF

Abstract

En 中文

This paper considers sparse regression modelling using a generalised kernel model in which each kernel regressor has its individually tuned centre vector and diagonal covariance matrix. An orthogonal least squares forward selection procedure is employed to select the regressors one by one, so as to determine the model structure. After the regressor selection, the corresponding model weight parameters are calculated from the Lagrange dual problem of the original regression problem with the regularised L-insensitive loss function. Unlike the support vector regression, this stage of the procedure involves neither reproducing kernel Hilbert space nor Mercer decomposition concepts. As the regressors used are not restricted to be positioned at training input points and each regressor has its own diagonal covariance matrix, sparser representation can be obtained. Experiments involving one simulated example and three real data sets are used to demonstrate the effectiveness of the proposed novel regression modelling approach. (c) 2006 Elsevier B.V. All rights reserved.

Keywords:

generalised kernel model

orthogonal least squares forward selection

regression

sparse modelling

support vector machine

Sparse support vector regression based on orthogonal forward selection for the generalised kernel model

Abstract

AI Summary

Journal

Organization