arrow
返回

Minimizing Off-Chip Memory Access for CNN Accelerators

delete2022-05-01
delete1
PRE
AI
S
Saurabh Tewari *
A
Anshul Kumar
K
Kolin Paul
DOI:10.1109/MCE.2021.3097697delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Convolution neural network (CNN) accelerators are commonly used to boost the CNN application's performance. The energy efficiency of the CNN accelerators is of paramount importance for battery-operated devices like smartphones. A substantial fraction of their energy consumption is due to off-chip memory accesses. These accelerators connect to the off-chip memory by a wide bus to improve the throughput. However, accessing the data from an unaligned address or size that is not a multiple of bus width leads to low bus width utilization and wastage of energy. Memory accesses can be reduced considerably by partitioning the data in a way that increases the number of aligned accesses and optimally utilizes bus width. We propose an approach that factors in the architectural parameters to evaluate the memory access. Our tool determines optimal partitioning and data reuse scheme for convolution and fully connected layers to minimize the off-chip memory accesses for these accelerators. Compared to state-of-the-art, our approach reduces off-chip memory accesses of AlexNet, VGG16, and ResNet:50 by 9%, 16%, and 28% on 64 bits data bus and by 16%, 29%, and 46% on 128 bits data bus, respectively.
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Consumer Electronics Magazine 封面图
IEEE Consumer Electronics Magazine
IF:
4.1
论文数:
1.3K
被引数:
1.8K

机构

I
indian institute of technology system (iit system)
学者数:
9.5W
论文数: 9.9W
被引数: 93
引用论文

引用论文

Milton’S Blindness
err
IF0
err2019-04-09
err0
PREAI
errEleanor Gertrude Brown
err分享
err收藏
Dose-dependent kinetics for theophylline: Observations among ambulatory asthmatic children
err1980-11-01
err0
PREAI
errEdward Sarrazin; Leslie Hendeles; Miles Weinberger; Keith Muir; Sidney Riegelman
err分享
err收藏
err分享
err收藏
Adeno-associated virus 2 infection in children with non-A-E hepatitis
err
IF0
err2022-07-19
err0
errOAAI
errAntonia Ho; Richard Orton; Rachel Tayler; Patawee Asamaphan; Lily Tong; Katherine Smollett; Chris Davis; Maria Manali; Sarah E. McDonald; Louisa Pollock; Clair Evans; Jim McMenamin; Kirsty Roy; Kimberly Marsh; Titus Divala; Matt Holden; Michael Lockhart; David Yirrell; Sandra Currie; Samantha J. Shepherd; Celia Jackson; Rory Gunson; Alasdair MacLean; Neil McInnes; Richard Battle; Jill Hollenbach; Paul Henderson; Meera Chand; Melissa Shea Hamilton; Diego Estrada-Rivadeneyra; Michael Levin; David L Robertson; Ana Filipe; Brian Willett; Judith Breuer; Malcolm G Semple; David Turner; J Kenneth Baillie; Emma C. Thomson
err分享
err收藏
err分享
err收藏
学者 查看更多内容