arrow
返回

Convolution in Convolution for Network in Network

delete2018-05-01
delete157
delete
OA
AI
Y
Yanwei Pang *
M
Manli Sun
姜晓恒 封面图
姜晓恒 (Xiaoheng Jiang)
李学龙 封面图
李学龙 (Xuelong Li)
DOI:10.1109/TNNLS.2017.2676130delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Network in network (NiN) is an effective instance and an important extension of deep convolutional neural network consisting of alternating convolutional layers and pooling layers. Instead of using a linear filter for convolution, NiN utilizes shallow multilayer perceptron (MLP), a nonlinear function, to replace the linear filter. Because of the powerfulness of MLP and 1 x 1 convolutions in spatial domain, NiN has stronger ability of feature representation and hence results in better recognition performance. However, MLP itself consists of fully connected layers that give rise to a large number of parameters. In this paper, we propose to replace dense shallow MLP with sparse shallow MLP. One or more layers of the sparse shallow MLP are sparely connected in the channel dimension or channel-spatial domain. The proposed method is implemented by applying unshared convolution across the channel dimension and applying shared convolution across the spatial dimension in some computational layers. The proposed method is called convolution in convolution (CiC). The experimental results on the CIFAR10 data set, augmented CIFAR10 data set, and CIFAR100 data set demonstrate the effectiveness of the proposed CiC method.
Keyword:
Convolution in convolution (CiC)
convolutional neural networks (CNNs)
image recognition
network in network (NiN)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Click‐evoked vestibulocollic reflexes in torticollis
err2004-10-12
err0
PREAI
errJ. G. Colebatch; V. Di Lazzaro; A. Quartarone; J. C. Rothwell; M. Gresty
err分享
err收藏
err分享
err收藏
Cascaded Subpatch Networks for Effective CNNs
err2017-01-01
err22
errOAAI
errJiang, Xiaoheng; Pang, Yanwei; Sun, Manli; Li, Xuelong
err分享
err收藏
Minimally invasive colorectal resection for cancer is associated with a short-lived decrease in soluble Tie-2 receptor levels, which may transiently inhibit VEGF-mediated angiogenesis (via altered blood levels of free Ang-1 and Ang-2)
err2010-03-31
err0
PREAI
errH. M. C. Shantha Kumara; Michael J. Grieco; Xiaohong Yan; Matthew F. Kalady; Vincent DiMaggio; Donald G. Kim; Neil Hyman; Daniel L. Feingold; Richard L. Whelan
err分享
err收藏
err分享
err收藏
Clonal analysis of adult human olfactory neurosphere forming cells
err2009-07-12
err0
PREAI
errM Othman; C Lu; K Klueber; W Winstead; Fj Roisen
err分享
err收藏
学者 查看更多内容