arrow
返回

ZEM: Zero-Cycle Bit-Masking Module for Deep Learning Refresh-Less DRAM

delete2021-01-01
delete6
delete
OA
AI
D
Duy-Thanh Nguyen
N
Nhut-Minh Ho
M
Minh-Son Le
W
Weng‐Fai Wong
I
Ik‐Joon Chang *
DOI:10.1109/ACCESS.2021.3088893delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In sub-20 nm technologies, DRAM cells suffer from poor retention time. With the technology scaling, this problem tends to be worse, significantly increasing refresh power of DRAM. This is more problematic in memory heavy applications such as deep learning systems, where a large amount of DRAM is required, DRAM refresh power contributes to a considerable portion of total system power. With the growth in deep learning workloads, this is set to get worse. In this work, we present a zero-cycle bit-masking (ZEM) scheme that exploits the asymmetry of retention failures, to eliminate DRAM refresh in the inference of convolution neural networks, natural language processing, and the image generation based on generative adversarial network. Through careful analysis, we derive a bit-error-rate (BER) threshold that does not affect the accuracy of inference. Our proposed architecture, along with the techniques involved, are applicable to all types of DRAMs. Our results on 16Gb devices show that ZEM can improve the performance by up to 17.31% while reducing the total energy consumed by DRAM by up to 43.03%, dependent on the type of DRAM.
Keyword:
Random access memory
Deep learning
Encoding
Task analysis
Memory management
Capacitors
Power demand
DNNs
inference
encoding
decoding
refresh-less DRAM
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

K
kyung hee university
学者数:
2.3W
论文数: 2.2W
被引数: 234
N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

Neuroeducation and Music
err2014-12-02
err0
PREAI
errLaurie Curtis; Jana Fallin
err分享
err收藏
err分享
err收藏
Molecular Characterization of Lipopolysaccharide Binding to Humanα-1-Acid Glycoprotein
err2012-01-01
err0
errOAAI
errJohnny X. Huang; Mohammad A. K. Azad; Elizabeth Yuriev; Mark A. Baker; Roger L. Nation; Jian Li; Matthew A. Cooper; Tony Velkov
err分享
err收藏
Theoretical Study of the Structure and Spectroscopic Properties of Cobalt(II) Coordinated to Six-Rings in Zeolites
err1998-12-08
err0
PREAI
errKristine Pierloot; Annelies Delabie; Carl Ribbing; An A. Verberckmoes; Robert A. Schoonheydt
err分享
err收藏
学者 查看更多内容