arrow
返回

Reconfigurable in-sensor processing based on a multi-phototransistor-one-memristor array

delete2024-11-12
delete1
PRE
AI
B
Bingjie Dang
张腾 封面图
张腾 (Teng Zhang)
X
Xulei Wu
K
Keqin Liu
R
Ru Huang
杨玉超 封面图
杨玉超 (Yuchao Yang) *
DOI:10.1038/s41928-024-01280-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Memristors with photonic sensory capabilities can be used as elements in machine vision systems but face challenges in terms of encoding and processing optical data. This has led to different neural network architectures being developed for specific vision tasks, which limits progress towards more versatile in-sensor vision computing platforms. Here we describe a multi-phototransistor and one-memristor array that is based on niobium oxide memristors. It has reconfigurable dynamics and is compatible with both machine learning (analogue) and bioinspired (spiking) neural network architectures. The array can sense and process optical images and synchronize spatio-temporal data across different encoding formats. When the array is coupled with a classifier network using a one-transistor and one-memristor non-volatile memory array, it supports a variety of optical neural networks (including optical convolutional neural networks, recurrent neural networks and spiking neural networks). The resulting system can perform various computing vision tasks, such as recognizing static, motion and colour images. Niobium oxide memristors with reconfigurable dynamics can be used to make an array integrated with phototransistors that can encode image information in analogue or spiking form and can support different neural network architectures for image processing tasks.
Keyword:
NEURAL-NETWORK

期刊

Nature Electronics 封面图
Nature Electronics
IF:
40.9
论文数:
1.7K
被引数:
2.1W

机构

P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
引用论文

引用论文

Novel triosmium clusters derived from the reaction of [Os3(CO)10(μ-dppm)] with 1-vinylimidazole
err2000-11-01
err0
PREAI
errJasmin Akter; Kazi A. Azam; Shariff E. Kabir; K.M. Abdul Malik; Md. Abdul Mottalib
err分享
err收藏
A 619-pixel machine vision enhancement chip based on two-dimensional semiconductors
err2022-08-05
err44
errOAAI
errMa, Shunli; Wu, Tianxiang; Chen, Xinyu; Wang, Yin; Ma, Jingyi; Chen, Honglei; Riaud, Antoine; Wan, Jing; Xu, Zihan; Chen, Lin; Ren, Junyan; Zhang, David Wei; Zhou, Peng; Chai, Yang; Bao, Wenzhong
err分享
err收藏
The future of electronics based on memristive systems基于忆阻系统的电子学的未来
err2018-01-08
err1.6K
PREAI
errZidan, Mohammed A.; Strachan, John Paul; Lu, Wei D.
err分享
err收藏
err分享
err收藏
Vertically integrated spiking cone photoreceptor arrays for color perception用于颜色感知的垂直集成尖锥光感受器阵列
err2023-06-10
err50
errOAAI
errWang, Xiangjing; Chen, Chunsheng; Zhu, Li; Shi, Kailu; Peng, Baocheng; Zhu, Yixin; Mao, Huiwu; Long, Haotian; Ke, Shuo; Fu, Chuanyu; Zhu, Ying; Wan, Changjin; Wan, Qing
err分享
err收藏
Reconfigurable, non-volatile neuromorphic photovoltaics可重构,非易失性神经形态光伏
err2023-07-20
err61
PREAI
errLi, Tangxin; Miao, Jinshui; Fu, Xiao; Song, Bo; Cai, Bin; Ge, Xun; Zhou, Xiaohao; Zhou, Peng; Wang, Xinran; Jariwala, Deep; Hu, Weida
err分享
err收藏
Origin of threshold voltage instability in indium-gallium-zinc oxide thin film transistors
err2008-09-25
err740
PREAI
errJeong, Jae Kyeong; Yang, Hui Won; Jeong, Jong Han; Mo, Yeon-Gon; Kim, Hye Dong
err分享
err收藏
Deep reservoir computing based on self-rectifying memristor synapse for time series prediction
err2023-07-27
err14
PREAI
errWang, Rui; Liang, Qi; Wang, Saisai; Cao, Yaxiong; Ma, Xiaohua; Wang, Hong; Hao, Yue
err分享
err收藏
学者 查看更多内容