arrow
Return

Sparse regularization for semi-supervised classification

delete2011-08-01
delete53
PRE
AI
樊明宇 cover
樊明宇 (Mingyu Fan)
N
Nannan Gu
B
Bo Zhang *
DOI:10.1016/j.patcog.2011.02.013delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Manifold regularization (MR) is a promising regularization framework for semi-supervised learning, which introduces an additional penalty term to regularize the smoothness of functions on data manifolds and has been shown very effective in exploiting the underlying geometric structure of data for classification. It has been shown that the performance of the MR algorithms depends highly on the design of the additional penalty term on manifolds. In this paper, we propose a new approach to define the penalty term on manifolds by the sparse representations instead of the adjacency graphs of data. The process to build this novel penalty term has two steps. First, the best sparse linear reconstruction coefficients for each data point are computed by the l(1)-norm minimization. Secondly, the learner is subject to a cost function which aims to preserve the sparse coefficients. The cost function is utilized as the new penalty term for regularization algorithms. Compared with previous semi-supervised learning algorithms, the new penalty term needs less input parameters and has strong discriminative power for classification. The least square classifier using our novel penalty term is proposed in this paper, which is called the Sparse Regularized Least Square Classification (S-RLSC) algorithm. Experiments on real-world data sets show that our algorithm is very effective. (C) 2011 Elsevier Ltd. All rights reserved.
Keywords:
Regularization theory
Semi-supervised learning
Regularized least square classification
Dimensionality reduction
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

A
academy of mathematics & system sciences, cas
Scholars:
755
Papers: 768
Citations: 0
C
chinese academy of sciences
Scholars:
56.1W
Papers: 44.8W
Citations: 704