.png){kind=icon}
返回
Dynamic ConvNets on Tiny Devices via Nested Sparsity
.png){kind=icon}
OA
AI
DOI：10.1109/JIOT.2022.3222014.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This work introduces a new training and compression pipeline to build nested sparse convolutional neural networks (ConvNets), a class of dynamic ConvNets suited for inference tasks deployed on resource-constrained devices at the edge of the Internet of Things. A nested sparse ConvNet consists of a single ConvNet architecture, containing $N$ sparse subnetworks with nested weights subsets, like a Matryoshka doll, and can trade accuracy for latency at runtime, using the model sparsity as a dynamic knob. To attain high accuracy at training time, we propose a gradient masking technique that optimally routes the learning signals across the nested weight subsets. To minimize the storage footprint and efficiently process the obtained models at inference time, we introduce a new sparse matrix compression format with dedicated compute kernels that fruitfully exploit the characteristic of the nested weights subsets. Tested on image classification and object detection tasks on an off-the-shelf ARM-M7 microcontroller unit (MCU), nested sparse ConvNets outperform variable-latency solutions naively built assembling single sparse models trained as stand-alone instances, achieving 1) comparable accuracy; 2) remarkable storage savings; and 3) high performance. Moreover, when compared to state-of-the-art dynamic strategies, such as dynamic pruning and layer width scaling, nested sparse ConvNets turn out to be Pareto optimal in the accuracy versus latency space.
Keyword:
Training
Internet of Things
Task analysis
Pipelines
Kernel
Computational modeling
Costs
latency-quality scaling
microcontroller units (MCUs)
neural network compression
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
Atomic-level dispersed catalysts for PEMFCs: Progress and future prospects用于pemfc的原子级分散催化剂: 进展和未来前景.png)
EnergyChem
EnergyChemIF0
PREAI
分享收藏分享收藏A convergent approach to (R)-Tiagabine by a regio- and stereocontrolled hydroiodination of alkynes
PREAI
分享收藏
查看更多内容