arrow
返回

Efficient neural network using pointwise convolution kernels with linear phase constraint

delete2021-01-01
delete12
PRE
AI
F
Feng Liang
Z
Zhichao Tian
M
Ming Dong
S
Shuting Cheng
L
Li Sun
李海 封面图
李海 (Hai Li)
Y
Yiran Chen
张国和 封面图
张国和 (Guohe Zhang) *
DOI:10.1016/j.neucom.2020.10.067delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
In current efficient convolutional neural networks, 1 x 1 convolution is widely used. However, the amount of computation and the number of parameters of 1 x 1 convolution layers account for a large part of these neural network models. In this paper, we propose to use linear-phase pointwise convolution kernels (LPPC kernels) to reduce the computational complexities and storage costs of these neural networks. We design four types of LPPC kernels based on the parity of the number of input channels and symmetry of the weights of the pointwise convolution kernel. Experimental results show that Type-I LPPC kernels can compress some popular networks better with a small reduction in accuracy than the other types of LPPC kernels. The LPPC kernels can be used as new 1 x 1 convolution kernels to design efficient neural network architectures in the future. Moreover, the LPPC kernels are friendly to low-power hardware accelerator design to achieve lower memory access cost and smaller model size. (c) 2020 Published by Elsevier B.V.
Keyword:
Convolutional Neural Network (CNN)
Efficient neural network
Pointwise convolution
Linear-phase filter
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

D
Duke University
学者数:
2.1K
论文数: 820
被引数: 0
X
Xi'an Jiaotong University
学者数:
8.0K
论文数: 2.2K
被引数: 0
引用论文

引用论文

ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
err分享
err收藏