Distance difference and linear programming nonparallel plane classifier

Qiaolin Ye

doi:10.1016/j.eswa.2011.01.131

2011-08-01

PRE

DOI：10.1016/j.eswa.2011.01.131

原文链接

摘要

En 中文

We first propose Distance Difference GEPSVM (DGEPSVM), a binary classifier that obtains two nonparallel planes by solving two standard eigenvalue problems. Compared with GEPSVM, this algorithm does not need to care about the singularity occurring in GEPSVM, but with better classification correctness. This formulation is capable of dealing with XOR problems with different distribution for keeping the genuine geometrical interpretation of primal GEPSVM. Moreover, the proposed algorithm gives classification correctness comparable to that of LSTSVM and TWSVM, but with lesser unknown parameters. Then, the regularization techniques are incorporated to the TWSVM. With the help of the regularized formulation, a linear programming formation for TWSVM is proposed, called FETSVM, to improve TWSVM sparsity, thereby suppressing input features. This means FETSVM is capable of reducing the number of input features, for linear case. When a nonlinear classifier is used, this means few kernel functions determine the classifier. Lastly, this algorithm is compared on artificial and public datasets. To further illustrate the effectiveness of our proposed algorithms, we also apply these algorithms to USPS handwritten digits. (C) 2011 Elsevier Ltd. All rights reserved.

Keyword:

GEPSVM

LSTSVM

TWSVM

Standard eigenvalues

Feature selection

Input features

Kernel functions