.png){kind=icon}
返回
Versatile, full-spectrum, and swift network sampling for model generation
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2022.108729.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Given one task, it is difficult to generate CNN models for many different hardware platforms with extremely diverse computing power for this task. Repeating network pruning or architecture search for each platform is very time-consuming. In this paper, we propose properties that are required for this model generation problem: versatile (fits diverse applications and network structures), full-spectrum (generates models for devices with tiny to gigantic computing power), and swift (total training time for all platforms is short, and generated models have low latency). We show that existing methods do not satisfy these requirements and propose a VFS method (the V/F/S represents Versatile/Full-spectrum/Swift, respectively). VFS uses importance sampling to sample many submodels with versatile structures and with different input image resolutions. We propose new fine-tuning strategies that only need to fine-tune a best candidate submodel for few epochs for each platform. VFS satisfies all three requirements. It generates versatile models with low latency for diverse applications, is suitable for devices with a wide range of computing power differences, and the models which are generated by VFS achieve state-of-the-art accuracy.(c) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Model generation
Convolutional neural networks
Structured pruning
Model compression
Model generation
Convolutional neural networks
Structured pruning
Model compression
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Differentiable neural architecture learning for efficient neural networks用于高效神经网络的可微分神经体系结构学习.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Explainable deep learning for efficient and robust pattern recognition: A survey of recent developments可解释的深度学习用于高效和鲁棒的模式识别: 近期发展综述PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏AutoPruner: An end-to-end trainable filter pruning method for efficient deep model inferenceAutoPruner: 一种用于高效深度模型推理的端到端可训练滤波器修剪方法PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏Pruning by explaining: A novel criterion for deep neural network pruning解释修剪: 一种新的深度神经网络修剪准则PATTERN RECOGNITIONOAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏 没有更多内容
没有更多内容