arrow
Return

Universum parametric ν-support vector regression for binary classification problems with its applications

delete2023-05-26
delete3
delete
OA
AI
H
Hossein Moosaei *
F
Fatemeh Bazikar
M
Milan Hladík
DOI:10.1007/s10479-023-05369-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Universum data sets, a collection of data sets that do not belong to any specific class in a classification problem, give previous information about data in the mathematical problem under consideration to enhance the classifiers' generalization performance. Recently, some researchers have integrated Universum data into the existing models to propose new models which result in improved classification performance. Inspired by these Universum models, an efficient parametric nu-support vector regression with Universum data (UPar-nu-SVR) is proposed in this work. This method, which finds two non-parallel hyperplanes by solving one optimization problem and considers heteroscedastic noise, overcomes some common disadvantages of the previous methods. The UPar-nu-SVR includes unlabeled samples that don't belong to any class in the training process, which results in a quadratic programming problem. Two approaches are proposed to solve this problem. The first approach derives the dual formulation using the Lagrangian function and KKT conditions. Furthermore, a least squares parametric nu-support vector regression with Universum data (named LS-UPar-nu-SVR) is suggested to further increase the generalization performance. The LS-UPar-nu-SVR solves a single system of linear equations, instead of addressing a quadratic programming problem in the dual formulation. Numerical experiments on artificial, UCI, credit card, NDC, and handwritten digit recognition data sets show that the suggested Universum model and its solving methodologies improve prediction accuracy.
Keywords:
Universum
Parametric nu-support vector regression
Least squares
Dual problem
Twin support vector machine

Journal

Annals of Operations Research cover
Annals of Operations Research
IF:
4.5
Papers:
8.0K
Citations:
2.1W

Organization

U
University of Guilan
Scholars:
3.5K
Papers: 3.4K
Citations: 3.0K
C
Charles University Prague
Scholars:
2.9W
Papers: 2.2W
Citations: 158
U
university of jan evangelista purkyne
Scholars:
983
Papers: 717
Citations: 1
researcher View more organizations