arrow
返回

Naive semi-supervised deep learning using pseudo-label

delete2018-12-10
delete32
PRE
AI
Z
Zhun Li
B
Byungsoo Ko
H
Ho‐Jin Choi *
DOI:10.1007/s12083-018-0702-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
To facilitate the utilization of large-scale unlabeled data, we propose a simple and effective method for semi-supervised deep learning that improves upon the performance of the deep learning model. First, we train a classifier and use its outputs on unlabeled data as pseudo-labels. Then, we pre-train the deep learning model with the pseudo-labeled data and fine-tune it with the labeled data. The repetition of pseudo-labeling, pre-training, and fine-tuning is called naive semi-supervised deep learning. We apply this method to the MNIST, CIFAR-10, and IMDB data sets, which are each divided into a small labeled data set and a large unlabeled data set by us. Our method achieves significant performance improvements compared to the deep learning model without pre-training. We further analyze the factors that affect our method to provide a better understanding of how to utilize naive semi-supervised deep learning in practical application.
Keyword:
Deep learning
Semi-supervised learning
Pseudo-label
Pre-training
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Peer-to-Peer Networking and Applications 封面图
Peer-to-Peer Networking and Applications
IF:
2.6
论文数:
2.2K
被引数:
2.9K

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
err分享
err收藏
err分享
err收藏
Training invariant support vector machines
err2002-01-01
err392
errOAAI
errDecoste, D; Schölkopf, B
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Utilization of palm oil waste as bioenergy
err2019-04-30
err0
errOAAI
errAmalia Murnihati Noerrizki; Tresna Kusuma Putri; Ernah Ernah
err分享
err收藏
A general preparation of β-substituted tryptophan esters
err1995-03-01
err0
PREAI
errLaurent Jeannin; Tamas Nagy; Elka Vassileva; Janos Sapi; Jean-Yves Laronze
err分享
err收藏
学者 查看更多内容