arrow
返回

A Heterogeneous System With Computing in Memory Processing Elements to Accelerate CNN Inference

delete2025-07-01
delete0
PRE
AI
J
Jinkai Wang
Y
Youxiang Chen
Z
Zekun Wang
Z
Zhengkun Gu
B
Bojun Zhang
H
Haiming Qiu
K
Kun Zhang
W
Weisheng Zhao
张
张跃 (Yue Zhang)
DOI:10.1109/TCSI.2025.3543104delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
存内计算(CIM)是集成逻辑于内存以提高计算性能的一种有前景的解决方案。本研究提出了一种基于超快CIM架构的高效异构系统(HS-CIM),用于加速卷积神经网络(CNN)推理。首先,基于静态随机存取存储器(SRAM),利用新颖的全输入和全数字方案实现了乘累加(MAC)操作,提出了超快CIM架构,有效解决了CIM架构中高精度计算导致的高延迟问题。其次,构建了基于所提出的CIM架构的异构系统(HS-CIM),配备了全局对齐缓存和自适应剪枝方案,以消除输入数据带宽限制导致的性能下降和精度损失。同时,提出了高效输入数据和权重数据映射方案,以最小化从缓存到CIM架构的输入数据传输延迟和能耗,从而在HS-CIM系统中实现高效CNN推理。最后,我们通过实现CNN的LeNet-5和VGG模型来识别MNIST和CIFAR-10数据集的图像,在布局层面分析了HS-CIM的性能。结果表明,所提出的CIM架构在8位输入/权重精度下的能效达到58.32 TOPS/W。同时,HS-CIM系统在MNIST和CIFAR-10上的推理准确率分别为99.25%和92.34%。
Keyword:
Computing in memory (CIM)
heterogeneous system
SRAM
CNN

期刊

IEEE Transactions on Circuits and Systems I-Regular Papers 封面图
IEEE Transactions on Circuits and Systems I-Regular Papers
IF:
5.2
论文数:
9.8K
被引数:
2.2W

机构

B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
引用论文

引用论文

A 7-nm Compute-in-Memory SRAM Macro Supporting Multi-Bit Input, Weight and Output and Achieving 351 TOPS/W and 372.4 GOPS
err2021-01-01
err0
PREAI
errMahmut E. Sinangil; Burak Erbagci; Rawan Naous; Kerem Akarvardar; Dar Sun; Win-San Khwa; Hung-Jen Liao; Yih Wang; Jonathan Chang
err分享
err收藏
8-b Precision 8-Mb ReRAM Compute-in-Memory Macro Using Direct-Current-Free Time-Domain Readout Scheme for AI Edge Devices
err2023-01-01
err0
PREAI
errJe-Min Hung; Tai-Hao Wen; Yen-Hsiang Huang; Sheng-Po Huang; Fu-Chun Chang; Chin-I Su; Win-San Khwa; Chung-Chuan Lo; Ren-Shuo Liu; Chih-Cheng Hsieh; Kea-Tiong Tang; Yu-Der Chih; Tsung-Yung Jonathan Chang; Meng-Fan Chang
err分享
err收藏
A 8-b-Precision 6T SRAM Computing-in-Memory Macro Using Segmented-Bitline Charge-Sharing Scheme for AI Edge Chips
err2023-03-01
err0
PREAI
errJian-Wei Su; Yen-Chi Chou; Ruhui Liu; Ta-Wei Liu; Pei-Jung Lu; Ping-Chun Wu; Yen-Lin Chung; Li-Yang Hong; Jin-Sheng Ren; Tianlong Pan; Chuan-Jia Jhang; Wei-Hsing Huang; Chih-Han Chien; Peng-I Mei; Sih-Han Li; Shyh-Shyuan Sheu; Shih-Chieh Chang; Wei-Chung Lo; Chih-I Wu; Xin Si; Chung-Chuan Lo; Ren-Shuo Liu; Chih-Cheng Hsieh; Kea-Tiong Tang; Meng-Fan Chang
err分享
err收藏
16.1 A 22nm 4Mb 8b-Precision ReRAM Computing-in-Memory Macro with 11.91 to 195.7TOPS/W for Tiny AI Edge Devices
err2021-02-13
err0
PREAI
errCheng-Xin Xue; Je-Min Hung; Hui-Yao Kao; Yen-Hsiang Huang; Sheng-Po Huang; Fu-Chun Chang; Peng Chen; Ta-Wei Liu; Chuan-Jia Jhang; Chin-I Su; Win-San Khwa; Chung-Chuan Lo; Ren-Shuo Liu; Chih-Cheng Hsieh; Kea-Tiong Tang; Yu-Der Chih; Tsung-Yung Jonathan Chang; Meng-Fan Chang
err分享
err收藏
Scalable and Programmable Neural Network Inference Accelerator Based on In-Memory Computing
err2022-01-01
err0
PREAI
errHongyang Jia; Murat Ozatay; Yinqi Tang; Hossein Valavi; Rakshit Pathak; Jinseok Lee; Naveen Verma
err分享
err收藏
A Local Computing Cell and 6T SRAM-Based Computing-in-Memory Macro With 8-b MAC Operation for Edge AI Chips
err2021-09-01
err0
PREAI
errXin Si; Yung-Ning Tu; Wei-Hsing Huang; Jian-Wei Su; Pei-Jung Lu; Jing-Hong Wang; Ta-Wei Liu; Ssu-Yen Wu; Ruhui Liu; Yen-Chi Chou; Yen-Lin Chung; William Shih; Chung-Chuan Lo; Ren-Shuo Liu; Chih-Cheng Hsieh; Kea-Tiong Tang; Nan-Chun Lien; Wei-Chiang Shih; Yajuan He; Qiang Li; Meng-Fan Chang
err分享
err收藏
学者 查看更多内容