arrow
Return

A fully trainable network with RNN-based pooling

delete2019-04-01
delete11
delete
OA
AI
S
Shuai Li *
W
Wanqing Li
C
Chris Cook
C
Ce Zhu
Y
Yanbo Gao
DOI:10.1016/j.neucom.2019.02.004delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Pooling is an important component in convolutional neural networks (CNNs) for aggregating features and reducing computational burden. Compared with other components such as convolutional layers and fully connected layers which are completely learned from data, the pooling component is still handcrafted such as max pooling and average pooling. This paper proposes a learnable pooling function using recurrent neural networks (RNN) so that the pooling can be fully adapted to data and other components of the network, leading to an improved performance. Such a network with learnable pooling function is referred to as a fully trainable network (FTN). Experimental results demonstrate that the proposed RNN based pooling can well approximate the existing pooling functions with just one neuron, thus making it appropriate to be used as pooling function in a network with its rich representation capability. Furthermore, experiments have shown that the proposed FTN can achieve better performance than the existing pooling methods under similar network architectures for image classification. (C) 2019 Elsevier B.V. All rights reserved.
Keywords:
Pooling
Recurrent neural network
Convolutional neural network
Deep learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

U
University of Wollongong
Scholars:
1.3W
Papers: 1.6W
Citations: 2.8W