arrow
Return

Pre-sensor computing with compact multilayer optical neural network

delete2024-07-26
delete2
delete
OA
AI
H
Huang Zheng
W
Wanxin Shi
S
Shukai Wu
Y
Yaode Wang
S
Sigang Yang
陈洪伟 cover
陈洪伟 (Hongwei Chen) *
DOI:10.1126/sciadv.ado8516delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Moving computation units closer to sensors is becoming a promising approach to addressing bottlenecks in computing speed, power consumption, and data storage. Pre-sensor computing with optical neural networks (ONNs) allows extensive processing. However, the lack of nonlinear activation and dependence on laser input limits the computational capacity, practicality, and scalability. A compact and passive multilayer ONN (MONN) is proposed, which has two convolution layers and an inserted nonlinear layer, performing pre-sensor computations with designed passive masks and a quantum dot film for incoherent light. MONN has an optical length as short as 5 millimeters, two orders of magnitude smaller than state-of-the-art lens-based ONNs. MONN outperforms linear single-layer ONN across various vision tasks, off-loading up to 95% of computationally expensive operations into optics from electronics. Motivated by MONN, a paradigm is emerging for mobile vision, fulfilling the demands for practicality, miniaturization, and low power consumption.
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Science Advances cover
Science Advances
IF:
12.5
Papers:
2.0W
Citations:
18.1W

Organization

T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137