arrow
返回

Efficient Model Switching in RRAM-Based DNN Accelerators

delete2025-10-01
delete1
PRE
AI
F
Fang-Yi Gu
I
Ing-Chao Lin *
B
Bing Li
U
Ulf Schlichtmann
G
Grace Li Zhang
DOI:10.1109/TCAD.2025.3550403delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Resistive random access memory (RRAM) has emerged as a promising technology for deep neural network (DNN) accelerators, but programming every weight in a DNN onto RRAM cells for inference can be both time-consuming and energy-intensive, especially when switching between different DNN models. This article introduces a hardware-aware multimodel merging (HA3M) framework designed to minimize the need for reprogramming by maximizing weight reuse, while taking into account the hardware constraints of the accelerator. The framework includes three key approaches: 1) crossbar (XB)-aware model mapping (XAMM); 2) block-based layer matching (BLM); and 3) multimodel retraining (MMR). XAMM reduces the XB usage of the preprogrammed model on RRAM XBs while preserving the model's structure. BLM reuses preprogrammed weights in a block-based manner, ensuring the inference process remains unchanged. MMR then equalizes the block-based matched weights across multiple models. Experimental results show that the proposed framework significantly reduces programming cycles in multi-DNN switching scenarios while maintaining or even enhancing accuracy, and eliminating the need for reprogramming.
Keyword:
Programming
Switches
Artificial neural networks
Computational modeling
Voltage
Hardware
Virtual machine monitors
Computer architecture
Integrated circuit modeling
Accuracy
Deep neural network (DNN)
model switching
multiple DNN application
resistive random access memory (RRAM)
RRAM programming
RRAM-based DNN accelerator

期刊

I
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
IF:
2.9
论文数:
668
被引数:
9.6K

机构

N
national cheng kung university
学者数:
3.6K
论文数: 1.4K
被引数: 0
T
technical university of darmstadt
学者数:
483
论文数: 200
被引数: 0
T
Technical University of Munich
学者数:
5.2W
论文数: 3.9W
被引数: 6.2W
U
Universitat Siegen
学者数:
2.9K
论文数: 2.7K
被引数: 18
学者 查看更多机构
引用论文

引用论文

Sparse ReRAM engine
err2019-06-22
err0
PREAI
errTzu-Hsien Yang; Hsiang-Yun Cheng; Chia-Lin Yang; I-Ching Tseng; Han-Wen Hu; Hung-Sheng Chang; Hsiang-Pang Li
err分享
err收藏
err分享
err收藏
Learning to Predict IR Drop with Effective Training for ReRAM-based Neural Network Hardware
err2020-07-01
err0
PREAI
errSugil Lee; Giju Jung; Mohammed E. Fouda; Jongeun Lee; Ahmed Eltawil; Fadi Kurdahi
err分享
err收藏
err分享
err收藏
PRIME
err2016-06-18
err0
PREAI
errPing Chi; Shuangchen Li; Cong Xu; Tao Zhang; Jishen Zhao; Yongpan Liu; Yu Wang; Yuan Xie
err分享
err收藏
Prototyping Reconfigurable RRAM-Based AI Accelerators Using the RISC-V Ecosystem and Digital Twins使用RISC-V生态系统和数字孪生技术原型化可重构的RRAM基AI加速器
err2023-08-25
err0
PREAI
errMarkus Fritscher; Alessandro Veronesi; Andrea Baroni; Jianan Wen; Thorsten Spätling; Mamathamba Kalishettyhalli Mahadevaiah; Norbert Herfurth; Eduardo Perez; Markus Ulbricht; Marc Reichenbach; Amelie Hagelauer; Milos Krstic
err分享
err收藏
学者 查看更多内容