arrow
Return

A Network Framework for Small-Sample Learning

delete2020-10-01
delete16
PRE
AI
D
Dongbo Liu
贺喆南 (Zhenan He)
D
Dongdong Chen
J
Jiancheng Lv *
DOI:10.1109/TNNLS.2019.2951803delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Small-sample learning involves training a neural network on a small-sample data set. An expansion of the training set is a common way to improve the performance of neural networks in small-sample learning tasks. However, improper constraints in expanding training data will reduce the performance of the neural networks. In this article, we present certain conditions for incorporation of additional training data. According to these conditions, we propose a neural network framework for self-training using self-generated data called small-sample learning network (SSLN). The SSLN consists of two parts: the expression learning network and the sample recall generative network, both of which are constructed based on restricted Boltzmann machine (RBM). We show that this SSLN can converge as well as the RBM. Moreover, the experiment results on MNIST Digit, SVHN, CIFAR10, and STL-10 data sets reveal the superiority of the SSLN over other models.
Keywords:
Neural networks
Training
Training data
Task analysis
Data models
Deep learning
Semisupervised learning
Expression learning network
generative network
restricted Boltzmann machine (RBM)
small-sample learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

S
sichuan university
Scholars:
11.9W
Papers: 7.7W
Citations: 100
U
University of Edinburgh
Scholars:
5.1W
Papers: 4.6W
Citations: 71