.png){kind=icon}
返回
DNN Model Compression for IoT Domain-Specific Hardware Accelerators
.png){kind=icon}
PRE
AI
DOI：10.1109/JIOT.2021.3111723.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Machine learning techniques, particularly those based on neural networks, are always more often used at the edge of the network by Internet of Things (IoT) nodes. Unfortunately, the computation capabilities demanded by those applications, together with their energy efficiency-related constraints, exceed those exposed by embedded general-purpose processors. For this reason, the use of domain-specific hardware accelerators (DSAs) is considered the most viable solution to the unsustainable Turing tariff of general-purpose hardware. Starting from the observation that memory and communication traffic account for a large fraction of the overall latency and energy in deep neural network (DNN) inferences, this article proposes a new compression technique aimed at: 1) reducing the memory footprint for storing the model parameters of a DNN and 2) improving DNN inference latency and energy on resource-constrained IoT devices. The proposed compression technique, namely, LineCompress, is applied on a set of representative convolutional neural networks (CNNs) for object recognition mapped on a state-of-the-art DSA targeted for resource-constrained IoT devices. We show that on average, 7.4 x memory footprint reduction can be obtained, thus reducing the memory and communication traffic that result to 77% and 87% inference latency and energy reduction, respectively, trading-off efficiency versus accuracy.
Keyword:
Deep neural network (DNN) accelerator
DNN model compression
domain-specific accelerator
energy versus performance versus accuracy tradeoff
neural networks
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
EBPC: Extended Bit-Plane Compression for Deep Neural Network Inference and Training Accelerators
OAAI
.png){kind=icon}
OAAI分享收藏Coverage of Amputation Stumps Using a Latissimus Dorsi Flap With a Serratus Anterior Muscle Flap
PREAI
分享收藏
查看更多内容