arrow
返回

Weight-Oriented Approximation for Energy-Efficient Neural Network Inference Accelerators

delete2020-12-01
delete67
PRE
AI
Z
Zois-Gerasimos Tasoulas *
G
Georgios Zervakis
I
Iraklis Anagnostopoulos
H
Hussam Amrouch
J
Jörg Henkel
DOI:10.1109/TCSI.2020.3019460delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Current research in the area of Neural Networks (NN) has resulted in performance advancements for a variety of complex problems. Especially, embedded system applications rely more and more on the utilization of convolutional NNs to provide services such as image/audio classification and object detection. The core arithmetic computation performed during NN inference is the multiply-accumulate (MAC) operation. In order to meet tighter and tighter throughput constraints, NN accelerators integrate thousands of MAC units resulting in a significant increase in power consumption. Approximate computing is established as a design alternative to improve the efficiency of computing systems by trading computational accuracy for high energy savings. In this work, we bring approximate computing principles and NN inference together by designing NN specific approximate multipliers that feature multiple accuracy levels at run-time. We propose a time-efficient automated framework for mapping the NN weights to the accuracy levels of the approximate reconfigurable accelerator. The proposed weight-oriented approximation mapping is able to satisfy tight accuracy loss thresholds, while significantly reducing energy consumption without any need for intensive NN retraining. Our approach is evaluated against several NNs demonstrating that it delivers high energy savings (17.8% on average) with a minimal loss in inference accuracy (0.5%).
Keyword:
Artificial neural networks
Approximate computing
Energy consumption
Convolution
Hardware
Embedded systems
Approximate computing
neural network inference
low-power
reconfigurable approximate multipliers
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Circuits and Systems I-Regular Papers 封面图
IEEE Transactions on Circuits and Systems I-Regular Papers
IF:
5.2
论文数:
9.8K
被引数:
2.2W

机构

S
Southern Illinois University
学者数:
2.9K
论文数: 2.4K
被引数: 1.4K
Southern Illinois University System 封面图
Southern Illinois University System
学者数:
6.0K
论文数: 5.0K
被引数: 55
引用论文

引用论文

Approximate Multipliers Based on New Approximate Compressors基于新近似压缩器的近似乘法器
err2018-12-01
err171
errOAAI
errEsposito, Darjn; Strollo, Antonio Giuseppe Maria; Napoli, Ettore; De Caro, Davide; Petra, Nicola
err分享
err收藏
Alzheimer’s disease
err2000-01-01
err0
PREAI
errArmand S. Schachter; Kenneth L. Davis
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Isochromosome 12p in mediastinal centroblastic lymphoma
err2008-10-09
err0
errOAAI
errPhilippe Genet; Hossein Mossafa; Marc Pulik
err分享
err收藏
Posttraumatic stress disorder, anger, and partner abuse among Vietnam combat veterans.
err2007-06-01
err0
PREAI
errCasey T. Taft; Amy E. Street; Amy D. Marshall; Deborah J. Dowdall; David S. Riggs
err分享
err收藏
学者 查看更多内容