arrow
返回

TIMAQ: A Time-Domain Computing-in-Memory-Based Processor Using Predictable Decomposed Convolution for Arbitrary Quantized DNNs

delete2021-10-01
delete16
PRE
AI
J
Jianxun Yang
Y
Yuyao Kong
Z
Zhao Zhang
Z
Zhuangzhi Liu
J
Jing Zhou
Y
Yiqi Wang
刘
刘永刚 (Yonggang Liu)
C
Chenfu Guo
T
Te Hu
C
Congcong Li
L
Leibo Liu
J
Jin Zhang
S
Shaojun Wei
J
Jun Yang
S
Shouyi Yin *
DOI:10.1109/JSSC.2021.3095232delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Energy-efficient processors are crucial for accelerating deep neural networks (DNNs) on edge devices with limited battery capacity. To reduce energy consumption, time-domain computing-in-memory (TD-CIM) is a splendid architecture, which consumes low computation and memory access energy due to low toggle rate of time-based signals and less data movements, respectively. When deploying DNNs in TD-CIMs, quantization is required, which has two types: uniform quantization (UQ) and nonuniform quantization (NUQ). To reach the same accuracy for one DNN, NUQ achieves smaller model size than UQ. Due to varying weight distributions across layers, mixed-precision quantization can further reduce model size, without degrading accuracy. However, previous TD-CIMs are inefficient for mixed-precision NUQ-DNNs due to their adopted bit-serial convolution increasing computation amount significantly. To address that, we propose a unique-weight convolution to accelerate mixed-precision NUQ-DNNs by a special kernel decomposition, reducing computation count remarkably. Based on that, we design a TD-CIM-based processor, TIMAQ, with three architectural techniques: 1) bit-cross-flipping-based kernel decomposer to reduce memory accesses and operations of decomposing kernels; 2) dual-mode-complementary predictor to remove redundant computations; and 3) activation-weight-adaptive pulse quantizer to decrease pulse quantization energy and error. Fabricated in 28-nm CMOS technology and tested on 1-8-b NUQ-DNNs, TIMAQ achieves 2.4-152.7-TOPS/W peak energy efficiency.
Keyword:
Indexes
Kernel
Convolution
Quantization (signal)
Time-domain analysis
Memory management
Delays
Computing-in-memory (CIM)
deep neural network (DNN) processor
nonuniform quantization (NUQ)
redundant computation
time-domain (TD) computing

期刊

I
IEEE Journal of Solid-State Circuits
IF:
5.6
论文数:
923
被引数:
2.7W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
S
southeast university - china
学者数:
5.3W
论文数: 4.9W
被引数: 57
引用论文

引用论文

Monkeypox vaccination in the global south: Fighting a war without a weapon
err2023-07-01
err0
errOAAI
errIsaac Olushola Ogunkola; Oyinloye Emmanuel Abiodun; Babatunde Ismail Bale; Emmanuel Ebuka Elebesunu; Somtochukwu Blessing Ujam; Innocent Chimaobi Umeh; Mfoniso Tom-James; Shuaibu Saidu Musa; Emery Manirambona; Salvador B. Evardone; Don Eliseo Lucero-Prisno
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
S4L: Self-Supervised Semi-Supervised Learning
err2019-10-01
err0
errOAAI
errXiaohua Zhai; Avital Oliver; Alexander Kolesnikov; Lucas Beyer
err分享
err收藏
err分享
err收藏
GEM: scalable and flexible gene–environment interaction analysis in millions of samples
err2021-05-25
err0
errOAAI
errKenneth E Westerman; Duy T Pham; Liang Hong; Ye Chen; Magdalena Sevilla-González; Yun Ju Sung; Yan V Sun; Alanna C Morrison; Han Chen; Alisa K Manning
err分享
err收藏
学者 查看更多内容