arrow
Return

Learning from Few Samples with Memory Network

delete2017-10-25
delete19
delete
OA
AI
S
Shufei Zhang
K
Kaizhu Huang *
R
Rui Zhang
A
Amir Hussain
DOI:10.1007/s12559-017-9507-zdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Neural networks (NN) have achieved great successes in pattern recognition and machine learning. However, the success of a NN usually relies on the provision of a sufficiently large number of data samples as training data. When fed with a limited data set, a NN's performance may be degraded significantly. In this paper, a novel NN structure is proposed called a memory network. It is inspired by the cognitive mechanism of human beings, which can learn effectively, even from limited data. Taking advantage of the memory from previous samples, the new model achieves a remarkable improvement in performance when trained using limited data. The memory network is demonstrated here using the multi-layer perceptron (MLP) as a base model. However, it would be straightforward to extend the idea to other neural networks, e.g., convolutional neural networks (CNN). In this paper, the memory network structure is detailed, the training algorithm is presented, and a series of experiments are conducted to validate the proposed framework. Experimental results show that the proposed model outperforms traditional MLP-based models as well as other competitive algorithms in response to two real benchmark data sets.
Keywords:
Memory
Multi-layer perceptron
Neural network
Recognition
Prior knowledge
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Cognitive Computation cover
Cognitive Computation
IF:
4.3
Papers:
1.6K
Citations:
3.6K

Organization

U
University of Stirling
Scholars:
3.7K
Papers: 4.2K
Citations: 5.8K
Cited Papers

Cited Papers

The effect of a novel extracorporeal cytokine hemoadsorption device on IL-6 elimination in septic patients: A randomized controlled trial
err2017-10-30
err0
errOAAI
errDirk Schädler; Christine Pausch; Daniel Heise; Andreas Meier-Hellmann; Jörg Brederlau; Norbert Weiler; Gernot Marx; Christian Putensen; Claudia Spies; Achim Jörres; Michael Quintel; Christoph Engel; John A. Kellum; Martin K. Kuhlmann
errShare
errSave
Electrolyte–electrolyte phase separation under the influence of a DC magnetic field
err2018-06-21
err0
PREAI
errYu. I. Gorobets; О. Yu. Gorobets; D. O. Derecha; Yu. B. Skirta; I. V. Gerasimchuk; V. V. Konovalova; A. A. Kyba
errShare
errSave
Visual Attention Model Based Vehicle Target Detection in Synthetic Aperture Radar Images: A Novel Approach
err2014-12-06
err24
PREAI
errGao, Fei; Zhang, Ye; Wang, Jun; Sun, Jinping; Yang, Erfu; Hussain, Amir
errShare
errSave
errShare
errSave
errShare
errSave
Fintech, financial inclusion and income inequality: a quantile regression approach
err2020-06-01
err0
errOAAI
errAyse Demir; Vanesa Pesqué-Cela; Yener Altunbas; Victor Murinde
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
researcher View more