arrow
Return

Hardware-Implemented DropConnect Function for Energy-Efficient Neuromorphic Computing

delete2025-05-09
delete0
PRE
AI
J
Jiachao Zhou
X
Xinwei Zhang
Y
Yishu Zhang
H
Huang, SM
A
Anzhe Chen
Z
Zhihao Gong
Z
Zongwen Li
L
Lin Wang
F
Fei Xue
汪
汪骅 (Hua Wang)
J
Jiayang Hu
H
Hanxi Li
徐
徐杨 (Yang Xu)
K
Kian Ping Loh
Y
Yishu Zhang
DOI:10.1002/adfm.202503452delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Achieving brain-level efficiency has long been the ultimate goal of computing. Considerable progress has been made in developing low-power neuromorphic building blocks to enable efficient neural network training. However, ultra-scalable nanodevices used for DropConnect regularization are demanded for full-hardware implementation of deep neural networks (DNNs). In this work, an energy-efficient ferroelectric synaptic transistor integrated with a threshold switch (TS) is presented, providing the proof-of-concept demonstration of hardware-implemented stochastic DropConnect function. The threshold switch enables stochastic dropout of synaptic weights by leveraging intrinsic variations that are difficult to eliminate, while unselected TS helps to minimize sneak-path currents. Compared to TS-free arrays, this approach reduces energy consumption by 31.7%. Further, two types of DNNs to show that the DropConnect can effectively combat the overfitting issue under different network architectures is explored. The research showcases a viable solution for the hardware implementation of scalable, resource-efficient DNNs.
Keywords:
artificial synapse
deep neural network
ferroelectric alpha-phase indium selenide
neuromorphic computing
threshold switch

Journal

Advanced Functional Materials cover
Advanced Functional Materials
IF:
19
Papers:
3.5W
Citations:
32.1W

Organization

N
Natl Univ Singapore
Scholars:
3.1K
Papers: 1.9K
Citations: 924
Cited Papers

Cited Papers

Intercorrelated In-Plane and Out-of-Plane Ferroelectricity in Ultrathin Two-Dimensional Layered Semiconductor In2Se3
err2018-02-05
err613
PREAI
errCui, Chaojie; Hu, Wei-Jin; Yan, Xingu; Addiego, Christopher; Gao, Wenpei; Wang, Yao; Wang, Zhe; Li, Linze; Cheng, Yingchun; Li, Peng; Zhang, Xixiang; Alshareef, Husam N.; Wu, Tom; Zhu, Wenguang; Pan, Xiaoqing; Li, Lain-Jong
errShare
errSave
Evolution of the COPD Assessment Test Score during Chronic Obstructive Pulmonary Disease Exacerbations: Determinants and Prognostic Value
err2013-01-01
err0
errOAAI
errDarwin Feliz-Rodriguez; Santiago Zudaire; Carlos Carpio; Elizabet Martínez; Antonia Gómez-Mendieta; Ana Santiago; Rodolfo Alvarez-Sala; Francisco García-Río
errShare
errSave
Highly transparent nonvolatile resistive memory devices from silicon oxide and graphene
err2012-10-02
err166
errOAAI
errYao, Jun; Lin, Jian; Dai, Yanhua; Ruan, Gedeng; Yan, Zheng; Li, Lei; Zhong, Lin; Natelson, Douglas; Tour, James M.
errShare
errSave
Prediction of intrinsic two-dimensional ferroelectrics in In2Se3 and other III2-VI3 van der Waals materials
err2017-04-07
err1.1K
errOAAI
errDing, Wenjun; Zhu, Jianbao; Wang, Zhe; Gao, Yanfei; Xiao, Di; Gu, Yi; Zhang, Zhenyu; Zhu, Wenguang
errShare
errSave
VTEAM: A General Model for Voltage-Controlled Memristors
err2015-08-01
err654
PREAI
errKvatinsky, Shahar; Ramadan, Misbah; Friedman, Eby G.; Kolodny, Avinoam
errShare
errSave
Insulators for 2D nanoelectronics: the gap to bridge
err2020-07-07
err315
errOAAI
errIllarionov, Yury Yu.; Knobloch, Theresia; Jech, Markus; Lanza, Mario; Akinwande, Deji; Vexler, Mikhail I.; Mueller, Thomas; Lemme, Max C.; Fiori, Gianluca; Schwierz, Frank; Grasser, Tibor
errShare
errSave
Coexistence of Grain-Boundaries-Assisted Bipolar and Threshold Resistive Switching in Multilayer Hexagonal Boron Nitride
err2017-02-01
err265
errOAAI
errPan, Chengbin; Ji, Yanfeng; Xiao, Na; Hui, Fei; Tang, Kechao; Guo, Yuzheng; Xie, Xiaoming; Puglisi, Francesco M.; Larcher, Luca; Miranda, Enrique; Jiang, Lanlan; Shi, Yuanyuan; Valov, Ilia; McIntyre, Paul C.; Waser, Rainer; Lanza, Mario
errShare
errSave
Artificial optic-neural synapse for colored and color-mixed pattern recognition
err2018-11-30
err555
errOAAI
errSeo, Seunghwan; Jo, Seo-Hyeon; Kim, Sungho; Shim, Jaewoo; Oh, Seyong; Kim, Jeong-Hoon; Heo, Keun; Choi, Jae-Woong; Choi, Changhwan; Oh, Saeroonter; Kuzum, Duygu; Wong, H. -S. Philip; Park, Jin-Hong
errShare
errSave
Recent Advances of Volatile Memristors: Devices, Mechanisms, and Applications
err2020-07-08
err142
errOAAI
errWang, Ruopeng; Yang, Jia-Qin; Mao, Jing-Yu; Wang, Zhan-Peng; Wu, Shuang; Zhou, Maojie; Chen, Tianyi; Zhou, Ye; Han, Su-Ting
errShare
errSave
researcher View more