arrow
Return

Semi-supervised learning with dropouts

delete2023-04-01
delete3
PRE
AI
A
Abhishek Singh
R
Rakesh Kumar Yadav *
S
Shekhar Verma
DOI:10.1016/j.eswa.2022.119235delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph Laplacian manifold regularization exploits the intrinsic geometrical properties of the underlying graph over both labeled and unlabeled data to approximate an optimal smooth prediction function. The regularization works on the assumption that abundant unlabeled data add information to the model, which increases accuracy and generalization. However, a large number of unlabeled data points with few labeled data points results in function degeneration which restricts generalization. Higher order regularization through iterated Laplacian semi-norm resolves this problem, but it is not computationally intensive and not scalable. In this paper, we propose dropouts regularization by appropriately balancing the supervised loss and intrinsic regularization terms to enforce smoothness. This is done by increasing the labeled data points by assigning temporary soft -labels to a subset of unlabeled set iteratively. This is followed by the determination of the final labels. Localized Procrustes analysis is, then, used to increase the accuracy of label assignment. Experiments on both synthetic and real-world dataset show that the proposed model outperforms the existing graph Laplacian and its variants by a significant margin.
Keywords:
Dropouts
Graph Laplacian
Manifold regularization
Localized Procrustes analysis

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

I
Indian Institute of Information Technology Allahabad
Scholars:
852
Papers: 626
Citations: 833