arrow
Return

Fully integrated multi-mode optoelectronic memristor array for diversified in-sensor computing

delete2024-11-08
delete0
PRE
AI
H
Heyi Huang
X
Xiangpeng Liang
Y
Yuyan Wang
J
Jianshi Tang
Y
Yuankun Li
Y
Yiwei Du
W
Wen Sun
J
Jianing Zhang
P
Peng Yao
X
Xing Mou
F
Feng Xu
J
Jinzhi Zhang
Y
Yuyao Lu
Z
Zhengwu Liu
J
Jianlin Wang
Z
Zhixing Jiang
R
Ruofei Hu
Z
Ze Wang
Q
Qingtian Zhang
B
Bin Gao
X
Xuedong Bai
L
Lu Fang
戴琼海 (Qionghai Dai)
H
Huaxiang Yin
H
He Qian
H
Huaqiang Wu *
DOI:10.1038/s41565-024-01794-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In-sensor computing, which integrates sensing, memory and processing functions, has shown substantial potential in artificial vision systems. However, large-scale monolithic integration of in-sensor computing based on emerging devices with complementary metal-oxide-semiconductor (CMOS) circuits remains challenging, lacking functional demonstrations at the hardware level. Here we report a fully integrated 1-kb array with 128 x 8 one-transistor one-optoelectronic memristor (OEM) cells and silicon CMOS circuits, which features configurable multi-mode functionality encompassing three different modes of electronic memristor, dynamic OEM and non-volatile OEM (NV-OEM). These modes are configured by modulating the charge density within the oxygen vacancies via synergistic optical and electrical operations, as confirmed by differential phase-contrast scanning transmission electron microscopy. Using this OEM system, three visual processing tasks are demonstrated: image sensory pre-processing with a recognition accuracy enhanced from 85.7% to 96.1% by the NV-OEM mode, more advanced object tracking with 96.1% accuracy using both dynamic OEM and NV-OEM modes and human motion recognition with a fully OEM-based in-sensor reservoir computing system achieving 91.2% accuracy. A system-level benchmark further shows that it consumes over 20 times less energy than graphics processing units. By monolithically integrating the multi-functional OEMs with Si CMOS, this work provides a cost-effective platform for diverse in-sensor computing applications. This study reports a fully integrated 128 x 8 optoelectronic memristor array with Si complementary metal-oxide-semiconductor circuits, featuring configurable multi-mode functionality. It demonstrates diversified in-sensor computing tasks and consumes 20 times less energy than GPUs.

Journal

Nature Nanotechnology cover
Nature Nanotechnology
IF:
34.9
Papers:
4.8K
Citations:
8.1W

Organization

T
tsinghua university
Scholars:
11.7W
Papers: 9.9W
Citations: 137
I
institute of microelectronics, cas
Scholars:
896
Papers: 618
Citations: 0
C
chinese academy of sciences
Scholars:
55.9W
Papers: 44.7W
Citations: 704
researcher View more organizations