arrow
Return

Leave-one-out manifold regularization

delete2012-04-01
delete10
PRE
AI
靳远 cover
靳远 (Jin Yuan)
刘雪梅 cover
刘雪梅 (Xuemei Liu) *
C
Chengliang Liu
DOI:10.1016/j.eswa.2011.11.004delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The manifold regularization (MR) based semi-supervised learning could explore structural relationships from both labeled and unlabeled data. However, the model selection of MR seriously affects its predictive performance due to the inherent additional geometry regularizer of labeled and unlabeled data. In this paper, two continuous and two inherent discrete hyperparameters are selected as optimization variables, and a leave-one-out cross-validation (LOOCV) based Predicted REsidual Sum of Squares (PRESS) criterion is first presented for model selection of MR to choose appropriate regularization coefficients and kernel parameters. Considering the inherent discontinuity of the two hyperparameters, the minimization process is implemented by using a improved Nelder-Mead simplex algorithm to solve the inherent discrete and continues hybrid variables set. The manifold regularization and model selection algorithm are applied to six synthetic and real-life benchmark dataset. The proposed approach, leveraged by effectively exploiting the embedded intrinsic geometric manifolds and unbiased LOOCV estimation, outperforms the original MR and supervised learning approaches in the empirical study. Crown Copyright (C) 2011 Published by Elsevier Ltd. All rights reserved.
Keywords:
Semi-supervised learning (SSL)
Leave-one-out cross-validation (LOOCV)
Manifold regularization (MR)
Model selection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159
S
Shandong Agricultural University
Scholars:
1.5W
Papers: 7.7K
Citations: 8