Convolutional neural network simplification via feature map pruning

Junhua Zou

doi:10.1016/j.compeleceng.2018.01.036

Return

Convolutional neural network simplification via feature map pruning

2018-08-01

PRE

DOI：10.1016/j.compeleceng.2018.01.036

Original

Original request for help

Save

Abstract

En 中文

Convolutional neural networks (CNNs) have been a focus area of machine learning in recent years, and they are widely used in vision and speech processing because of their superior performance. However, CNNs are usually resource-heavy to ensure higher accuracy, i.e., an accurate network with millions of parameters requires high performance computing devices. This prevents the use of CNNs in resource-limited hardware. In this paper, we propose a novel CNN simplification method to prune feature maps with relatively low discriminability magnitudes, which can produce a simplified CNN with reduced computational cost. Specifically, we define the critical points among the discriminability values of feature maps in each convolutional layer, and use these critical points to easily find the best pruning number of feature maps. Our experimental results show that in each convolutional layer of the VGG model, 15.6% to 59.7% of feature maps can be pruned without any loss of accuracy in classification tasks. (C) 2018 Elsevier Ltd. All rights reserved.

Keywords:

Convolutional neural network

Feature maps pruning

Discriminability

Critical points

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.