arrow
返回

PISA: A Non-Volatile Processing-in-Sensor Accelerator for Imaging Systems

delete2023-10-01
delete2
PRE
AI
S
Shaahin Angizi *
S
Sepehr Tabrizchi
D
David Z. Pan
A
Arman Roohi
DOI:10.1109/TETC.2023.3292251delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This work proposes a Processing-In-Sensor Accelerator, namely PISA, as a flexible, energy-efficient, and high-performance solution for real-time and smart image processing in AI devices. PISA intrinsically implements a coarse-grained convolution operation in Binarized-Weight Neural Networks (BWNNs) leveraging a novel compute-pixel with non-volatile weight storage at the sensor side. This remarkably reduces the power consumption of data conversion and transmission to an off-chip processor. The design is completed with a bit-wise near-sensor in-memory computing unit to process the remaining network layers. Once the object is detected, PISA switches to typical sensing mode to capture the image for a fine-grained convolution using only a near-sensor processing unit. Our circuit-to-application co-simulation results on a BWNN acceleration demonstrate minor accuracy degradation on various image datasets in coarse-grained evaluation compared to baseline BWNN models, while PISA achieves a frame rate of 1000 and efficiency of similar to 1.74 TOp/s/W. Lastly, PISA substantially reduces data conversion and transmission energy by similar to 84% compared to a baseline.
Keyword:
Magnetic memories
processing-in-sensor
accelerator

期刊

IEEE Transactions on Emerging Topics in Computing 封面图
IEEE Transactions on Emerging Topics in Computing
IF:
5.4
论文数:
1.1K
被引数:
3.4K

机构

N
New Jersey Institute of Technology
学者数:
4.2K
论文数: 4.5K
被引数: 4.6K
U
University of Nebraska Lincoln
学者数:
7.8K
论文数: 6.5K
被引数: 2.0W
University of Nebraska System 封面图
University of Nebraska System
学者数:
2.7W
论文数: 2.3W
被引数: 58
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Deep subnanosecond spin torque switching in magnetic tunnel junctions with combined in-plane and perpendicular polarizers
err2011-03-10
err78
PREAI
errRowlands, G. E.; Rahman, T.; Katine, J. A.; Langer, J.; Lyle, A.; Zhao, H.; Alzate, J. G.; Kovalev, A. A.; Tserkovnyak, Y.; Zeng, Z. M.; Jiang, H. W.; Galatsis, K.; Huai, Y. M.; Amiri, P. Khalili; Wang, K. L.; Krivorotov, I. N.; Wang, J-P
err分享
err收藏
err分享
err收藏
Nickel-mediated cyclization of enynes under an atmosphere of carbon dioxide
err2006-08-01
err0
PREAI
errMasanori Takimoto; Takashi Mizuno; Miwako Mori; Yoshihiro Sato
err分享
err收藏
Immunostimulatory Oligonucleotides Inhibit Colonic Proinflammatory Cytokine Production in Ulcerative Colitis
err2006-05-01
err0
PREAI
errDaniel Rachmilewitz; Fanny Karmeli; Shimon Shteingart; Jongdae Lee; Kenji Takabayashi; Eyal Raz
err分享
err收藏
学者 查看更多内容