arrow
Return

Hardware-Implemented DropConnect Function for Energy-Efficient Neuromorphic Computing

delete2025-05-09
delete0
PRE
AI
J
Jiachao Zhou
X
Xinwei Zhang
Y
Yishu Zhang
H
Huang, SM
A
Anzhe Chen
Z
Zhihao Gong
Z
Zongwen Li
L
Lin Wang
F
Fei Xue
汪骅 (Hua Wang)
J
Jiayang Hu
H
Hanxi Li
徐杨 (Yang Xu)
K
Kian Ping Loh
Y
Yishu Zhang
DOI:10.1002/adfm.202503452delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Achieving brain-level efficiency has long been the ultimate goal of computing. Considerable progress has been made in developing low-power neuromorphic building blocks to enable efficient neural network training. However, ultra-scalable nanodevices used for DropConnect regularization are demanded for full-hardware implementation of deep neural networks (DNNs). In this work, an energy-efficient ferroelectric synaptic transistor integrated with a threshold switch (TS) is presented, providing the proof-of-concept demonstration of hardware-implemented stochastic DropConnect function. The threshold switch enables stochastic dropout of synaptic weights by leveraging intrinsic variations that are difficult to eliminate, while unselected TS helps to minimize sneak-path currents. Compared to TS-free arrays, this approach reduces energy consumption by 31.7%. Further, two types of DNNs to show that the DropConnect can effectively combat the overfitting issue under different network architectures is explored. The research showcases a viable solution for the hardware implementation of scalable, resource-efficient DNNs.
Keywords:
artificial synapse
deep neural network
ferroelectric alpha-phase indium selenide
neuromorphic computing
threshold switch

Journal

Advanced Functional Materials cover
Advanced Functional Materials
IF:
19
Papers:
3.4W
Citations:
32.1W

Organization

N
Natl Univ Singapore
Scholars:
3.1K
Papers: 1.9K
Citations: 924