.png){kind=icon}
返回
GenExp: Multi-objective pruning for deep neural network based on genetic algorithm
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2021.04.022.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Unstructured deep neural network (DNN) pruning have been widely studied. However, previous schemes only focused upon compressing the model's memory footprint, which had led to relatively low reduction ratio in computational workload. This study demonstrates that the main reason behind is the inconsistent distribution of memory footprint and workload of the DNN model among different layers. Based on this observation, we propose to map the network pruning flow as a multi-objective optimization problem and design an improved genetic algorithm, which can efficiently explore the whole pruning structure space with both pruning goals equally constrained, to find the suitable solution that strikes a judicious balance between the DNN's model size and workload. Experiments show that the proposed scheme can achieve up to 34% further reduction on the model's computational workload compared to the state-of-the-art pruning scheme [11,33] for ResNet50 on the ILSVRC-2012 dataset. We have also deployed the pruned ResNet50 models on a dedicated DNN accelerator, and the measured data have shown a considerable 6x reduction in inference time compared to FPGA accelerator implementing dense CNN model quantized in INT8 format, and a 2:27x improvement in power efficiency over 2080Ti GPUbased implementations, respectively. (c) 2021 Elsevier B.V. All rights reserved.
Keyword:
Efficient inference
Network compression
Weights pruning
Genetic algorithm
Convolutional neural networks
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Multiobjective ResNet pruning by means of EMOAs for remote sensing scene classification.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
The power of obfuscation techniques in malicious JavaScript code: A measurement study恶意JavaScript代码中混淆技术的功能: 一项测量研究
OAAI
OAAI分享收藏
查看更多内容