arrow
返回

Hierarchical neural network with efficient selection inference

delete2023-04-01
delete1
PRE
AI
J
Jian‐Xun Mi
N
Nuo Li *
K
Ke-Yang Huang
W
Weisheng Li
L
Lifang Zhou
DOI:10.1016/j.neunet.2023.02.015delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The image classification precision is vastly enhanced with the growing complexity of convolutional neural network (CNN) structures. However, the uneven visual separability between categories leads to various difficulties in classification. The hierarchical structure of categories can be leveraged to deal with it, but a few CNNs pay attention to the character of data. Besides, a network model with a hierarchical structure is promising to extract more specific features from the data than current CNNs, since, for the latter, all categories have the same fixed number of layers for feed-forward computation. In this paper, we propose to use category hierarchies to integrate ResNet-style modules to form a hierarchical network model in a top-down manner. To extract abundant discriminative features and improve the computation efficiency, we adopt residual block selection based on coarse categories to allocate different computation paths. Each residual block works as a switch to determine the JUMP or JOIN mode for an individual coarse category. Interestingly, since some categories need less feedforward computation than others by jumping layers, the average inference time cost is reduced. Extensive experiments show that our hierarchical network achieves higher prediction accuracy with similar FLOPs on CIFAR-10 and CIFAR-100, SVHM, and Tiny-ImageNet datasets compared to original residual networks and other existing selection inference methods. (c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Convolutional neural network (CNN)
Image classification
Category hierarchy
Dynamic computation
Path decision search

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

C
chongqing university of posts & telecommunications
学者数:
6.7K
论文数: 5.3K
被引数: 5
引用论文

引用论文

err分享
err收藏
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
err分享
err收藏
The Ge−P (Germanium-Phosphorus) system
err1985-06-01
err0
PREAI
errR. W. Olesinski; N. Kanani; G. J. Abbaschian
err分享
err收藏
err分享
err收藏
Effect of Oil Massage on Growth in Preterm Neonates Less than 1800 g: A Randomized Control Trial
err2012-10-04
err0
PREAI
errJagdish Kumar; Amit Upadhyay; Ajeet Kumar Dwivedi; Sunil Gothwal; Vijay Jaiswal; Sunny Aggarwal
err分享
err收藏
Embedding Visual Hierarchy With Deep Networks for Large-Scale Visual Recognition
err2018-10-01
err29
errOAAI
errZhao, Tianyi; Zhang, Baopeng; He, Ming; Zhang, Wei; Zhou, Ning; Yu, Jun; Fan, Jianping
err分享
err收藏
学者 查看更多内容