arrow
返回

Balanced Decoupled Spatial Convolution for CNNs

delete2019-11-01
delete7
PRE
AI
G
Guotian Xie
K
Kuiyuan Yang
张挺 封面图
张挺 (Ting Zhang)
J
Jingdong Wang *
J
Jianhuang Lai *
DOI:10.1109/TNNLS.2019.2892035delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we are interested in designing lightweight CNNs by decoupling the convolution along the spatial and channel dimension. Most existing decoupling techniques focus on approximating the filter matrix through decomposition. In contrast, we provide a decoupled view of the standard convolution to separate the spatial information and the channel information. The resulting decoupled process is exactly equivalent to the standard convolution. Inspired from our decoupled view, we propose an effective structure, balanced decoupled spatial convolution (BDSC), to relax the sparsity of the filter in spatial aggregation by learning a spatial configuration and reduce the redundancy by reducing the number of intermediate channels. We also designed an adaptive spatial configuration, which is simply adding a nonlinear activation layer [rectified linear units (ReLU)] after the intermediate output. Our experiments verify that the adaptive spatial configuration can improve the classification performance without extra cost. In addition, our BDSC achieves comparable classification performance with the standard convolution but with a smaller model size on Canadian Institute for Advanced Research (CIFAR)-100, CIFAR-10, and ImageNet. To show the potential of further reducing the redundancy of across channel-domain convolution, we also show experiments of our models with a designed lightweight across channel-domain convolution. Finally, we show in our experiments that our models achieve superior performance than the state-of-the-art models.
Keyword:
Convolution
Redundancy
Standards
Correlation
Face
Image color analysis
Adaptation models
Adaptive spatial configuration
balanced decoupled spatial convolution (BDSC)
decomposing filter
redundancy of across channel-domain projection
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
引用论文

引用论文

Uncertainty and Variation of Remotely Sensed Lake Ice Phenology across the Tibetan Plateau
err2018-09-25
err0
errOAAI
errLinan Guo; Yanhong Wu; Hongxing Zheng; Bing Zhang; Junsheng Li; Fangfang Zhang; Qian Shen
err分享
err收藏
Drug Discovery for Pemphigoid Diseases
err2019-02-20
err0
PREAI
errAnika Kasprick; Katja Bieber; Ralf J. Ludwig
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
err分享
err收藏
学者 查看更多内容