.png){kind=icon}
Return
Lightweight Deep Neural Network Model With Padding-Free Downsampling
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2024.3374057.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Deep neural networks have achieved impressive performance in image classification tasks. However, due to limitations in hardware resources, including computing units and storage capacity, deploying these networks directly on resource-constrained devices such as mobile and edge devices is challenging. While lightweight network models have made significant advancements, the downsampling stage has received little attention. As the feature map is reused multiple times, the reduction of its size during the downsampling stage not only reduces the computational cost of the downsampling module itself but also lowers the computational burden of subsequent stages. This letter addresses this gap by proposing a padding-free downsampling module that effectively reduces computational costs and can seamlessly integrates into various deep learning models. Furthermore, we introduce a hybrid stem layer to obtain competitive accuracy. Extensive experiments were conducted on CIFAR-100, Stanford Dogs, and ImageNet datasets. On the CIFAR-100 dataset, the results show that the proposed module reduces computational costs by approximately 20% and improves inference speed on resource-constrained devices by around 10%.
Keywords:
Deep learning
image classification
model architecture design
neural network lightweighting
Journal
IF:
9.6
Papers:
1.1W
Citations:
1.7W
Organization
Cited Papers
.png){kind=icon}
ShareSave
ShareSave
ShareSaveShareSaveKD-LightNet: A Lightweight Network Based on Knowledge Distillation for Industrial Defect Detection
PREAI
ShareSave
View more