arrow
Return

Naive semi-supervised deep learning using pseudo-label

delete2018-12-10
delete32
PRE
AI
Z
Zhun Li
B
Byungsoo Ko
H
Ho‐Jin Choi *
DOI:10.1007/s12083-018-0702-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
To facilitate the utilization of large-scale unlabeled data, we propose a simple and effective method for semi-supervised deep learning that improves upon the performance of the deep learning model. First, we train a classifier and use its outputs on unlabeled data as pseudo-labels. Then, we pre-train the deep learning model with the pseudo-labeled data and fine-tune it with the labeled data. The repetition of pseudo-labeling, pre-training, and fine-tuning is called naive semi-supervised deep learning. We apply this method to the MNIST, CIFAR-10, and IMDB data sets, which are each divided into a small labeled data set and a large unlabeled data set by us. Our method achieves significant performance improvements compared to the deep learning model without pre-training. We further analyze the factors that affect our method to provide a better understanding of how to utilize naive semi-supervised deep learning in practical application.
Keywords:
Deep learning
Semi-supervised learning
Pseudo-label
Pre-training
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Peer-to-Peer Networking and Applications cover
Peer-to-Peer Networking and Applications
IF:
2.6
Papers:
2.2K
Citations:
2.9K

Organization

No organization information available
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
errShare
errSave
Training invariant support vector machines
err2002-01-01
err392
errOAAI
errDecoste, D; Schölkopf, B
errShare
errSave
ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
Utilization of palm oil waste as bioenergy
err2019-04-30
err0
errOAAI
errAmalia Murnihati Noerrizki; Tresna Kusuma Putri; Ernah Ernah
errShare
errSave
A general preparation of β-substituted tryptophan esters
err1995-03-01
err0
PREAI
errLaurent Jeannin; Tamas Nagy; Elka Vassileva; Janos Sapi; Jean-Yves Laronze
errShare
errSave
researcher View more