arrow
返回

Variable-Precision Approximate Floating-Point Multiplier for Efficient Deep Learning Computation

delete2022-05-01
delete11
PRE
AI
H
Hao Zhang
S
Seok‐Bum Ko *
DOI:10.1109/TCSII.2022.3161005delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this brief, a variable-precision approximate floating-point multiplier is proposed for energy efficient deep learning computation. The proposed architecture supports approximate multiplication with BFloat16 format. As the input and output activations of deep learning models usually follow normal distribution, inspired by the posit format, for numbers with different values, different precisions can be applied to represent them. In the proposed architecture, posit encoding is used to change the level of approximation, and the precision of the computation is controlled by the value of product exponent. For large exponent, smaller precision multiplication is applied to mantissa and for small exponent, higher precision computation is applied. Truncation is used as approximate method in the proposed design while the number of bit positions to be truncated is controlled by the values of the product exponent. The proposed design can achieve 19% area reduction and 42% power reduction compared to the normal BFloat16 multiplier. When applying the proposed multiplier in deep learning computation, almost the same accuracy as that of normal BFloat16 multiplier can be achieved.
Keyword:
Deep learning
Encoding
Computer architecture
Computational efficiency
Circuits and systems
Adders
Hardware design languages
Approximate multiplier
posit format
deep learning computation
variable precision

期刊

I
IEEE Transactions on Circuits and Systems and Express Briefs
IF:
4.9
论文数:
8.8K
被引数:
2.5W

机构

O
ocean university of china
学者数:
3.1W
论文数: 2.0W
被引数: 21
U
University of Saskatchewan
学者数:
1.5W
论文数: 1.4W
被引数: 1.7W
引用论文

引用论文

Quality of Life, Emotional Status, and Adherence of HIV-1–Infected Patients Treated With Efavirenz Versus Protease Inhibitor–Containing Regimens
err2002-03-01
err0
PREAI
errCarmina R. Fumaz; Albert Tuldrà; Ma José Ferrer; Roger Paredes; Anna Bonjoch; Toni Jou; Eugènia Negredo; Joan Romeu; Guillem Sirera; Cristina Tural; Bonaventura Clotet
err分享
err收藏
err分享
err收藏
The effect of concentration and duration of normobaric oxygen in reducing caspase-3 and -9 expression in a rat-model of focal cerebral ischaemia
err2015-08-01
err0
errOAAI
errSuyan Chen; Huizhen Peng; Anne Rowat; Feng Gao; Zhenxiang Zhang; Peng Wang; Weihong Zhang; Xianyuan Wang; Lixia Qu
err分享
err收藏
Changes in anger in relationship to responsivity to PTSD treatment.
err2014-01-01
err0
errOAAI
errTara E. Galovski; Lisa S. Elwood; Leah M. Blain; Patricia A. Resick
err分享
err收藏
Efficient Mitchell's Approximate Log Multipliers for Convolutional Neural Networks
err2019-05-01
err81
PREAI
errKim, Min Soo; Del Barrio, Alberto A.; Oliveira, Leonardo Tavares; Hermida, Roman; Bagherzadeh, Nader
err分享
err收藏
学者 查看更多内容