返回
Reconfigurable in-sensor processing based on a multi-phototransistor-one-memristor array
DOI:10.1038/s41928-024-01280-3.png)
摘要
En 中文
Memristors with photonic sensory capabilities can be used as elements in machine vision systems but face challenges in terms of encoding and processing optical data. This has led to different neural network architectures being developed for specific vision tasks, which limits progress towards more versatile in-sensor vision computing platforms. Here we describe a multi-phototransistor and one-memristor array that is based on niobium oxide memristors. It has reconfigurable dynamics and is compatible with both machine learning (analogue) and bioinspired (spiking) neural network architectures. The array can sense and process optical images and synchronize spatio-temporal data across different encoding formats. When the array is coupled with a classifier network using a one-transistor and one-memristor non-volatile memory array, it supports a variety of optical neural networks (including optical convolutional neural networks, recurrent neural networks and spiking neural networks). The resulting system can perform various computing vision tasks, such as recognizing static, motion and colour images. Niobium oxide memristors with reconfigurable dynamics can be used to make an array integrated with phototransistors that can encode image information in analogue or spiking form and can support different neural network architectures for image processing tasks.
Keyword:
NEURAL-NETWORK
期刊
IF:
40.9
论文数:
1.7K
被引数:
2.1W
机构
引用论文
A 619-pixel machine vision enhancement chip based on two-dimensional semiconductors
SCIENCE ADVANCES
IF12.5
Reservoir computing using dynamic memristors for temporal information processing使用动态忆阻器进行时间信息处理的储层计算
NATURE COMMUNICATIONS
IF15.7
Vertically integrated spiking cone photoreceptor arrays for color perception用于颜色感知的垂直集成尖锥光感受器阵列
NATURE COMMUNICATIONS
IF15.7

